00000001:02000400:1.0F:1788510180.457305:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788510188.266584:0:3163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788510189.058531:0:3209:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1375 MB/s 00000001:01000000:0.0:1788510189.308677:0:3209:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1671 MB/s 00000001:01000000:0.0:1788510189.558278:0:3209:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10875 MB/s 00000020:02000000:0.0:1788510189.818062:0:3257:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_4_g439d16b 00000400:02000000:3.0F:1788510190.163722:0:3272:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.104@tcp [8/256/0/180] 00008000:02000000:0.0:1788510192.426195:0:3421:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788510243.141754:0:5227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788510256.246599:0:5802:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788510256.246607:0:5802:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788510256.246724:0:5802:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005b5743f4 00000080:02000400:3.0:1788510256.246735:0:5802:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788510256.262492:0:5802:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788510256.262508:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788510256.262549:0:5802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b0c3b90b) 00000020:00000080:3.0:1788510256.262569:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788510256.295793:0:5802:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788510256.296526:0:5802:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0F:1788510256.353530:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788510256.353582:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788510256.353603:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788510256.353654:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788510256.353681:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788510256.354073:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788510256.354082:0:5802:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788510256.354094:0:5802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed65057 00000020:01000004:2.0:1788510256.354103:0:5802:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788510256.354107:0:5802:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788510256.354112:0:5802:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005b5743f4 from MGS 00000020:01000004:2.0:1788510256.354115:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788510256.354135:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000dec504c8) 00000020:00000080:2.0:1788510256.354146:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788510256.354214:0:5802:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005b5743f4 from MGS, refs=2 00080000:01000000:2.0:1788510256.354220:0:5802:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788510256.354266:0:5802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed65065 00000100:00100000:2.0:1788510256.354369:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788510256.355204:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788510256.355211:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788510256.364295:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788510256.364310:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788510256.365344:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788510256.365548:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788510256.365554:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788510256.367981:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788510256.368000:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788510256.374016:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788510256.378176:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788510256.379884:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510256.379890:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510256.379892:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510256.380374:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510256.380385:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510256.380387:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510256.388445:0:5802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788510256.400929:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788510256.639849:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1793 MB/s 00000001:01000000:2.0:1788510256.890069:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2595 MB/s 00000001:01000000:1.0:1788510257.140829:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 382 MB/s 00000001:01000000:2.0:1788510257.390866:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 695 MB/s 00080000:10000000:2.0:1788510257.399449:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1788510257.412444:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788510257.421381:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788510257.421398:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788510257.421401:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788510257.437147:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788510257.438836:0:5802:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788510257.438909:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788510257.439512:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788510257.439547:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788510257.439925:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788510257.440736:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788510257.440742:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788510257.451415:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788510257.451431:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788510257.452336:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788510257.452348:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788510257.457620:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:1.0:1788510257.457625:0:5817:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:2.0:1788510257.457651:0:5802:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.104@tcp' 00000020:01000004:2.0:1788510257.457659:0:5802:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788510257.457708:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.104@tcp (typ=mgc) 00000020:00000080:2.0:1788510257.457728:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.104@tcp (000000005ef7ba35) 00000020:00000080:2.0:1788510257.457745:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788510257.457834:0:5802:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007879e715@MGC192.168.201.104@tcp: add connection 192.168.201.104@tcp at head 00010000:00010000:2.0:1788510257.458037:0:5802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.104@tcp-0 is initialized 00000040:01000000:2.0:1788510257.458044:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.104@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788510257.459542:0:5818:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788510257.460122:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.104@tcp (uuid 040cea51-0882-49ef-ac64-3cc6497ba05a) 00000020:00000080:2.0:1788510257.460147:0:5802:0:(genops.c:1385:class_connect()) connect: client 040cea51-0882-49ef-ac64-3cc6497ba05a, cookie 0x3e734462ed65073 00000100:00080000:2.0:1788510257.460163:0:5802:0:(import.c:545:import_select_connection()) MGC192.168.201.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788510257.460169:0:5802:0:(import.c:665:import_select_connection()) MGC192.168.201.104@tcp: import 000000007879e715 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:2.0:1788510257.460629:0:5802:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000243047fe x1875388860989568/t0(0) o250->MGC192.168.201.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788510257.460657:0:5802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 040cea51-0882-49ef-ac64-3cc6497ba05a->MGS 00000020:01000004:2.0:1788510257.460675:0:5802:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788510257.460681:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788510257.460694:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000008bb6ccc6) 00000100:00100000:0.0:1788510257.461187:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000243047fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:040cea51-0882-49ef-ac64-3cc6497ba05a:3287:1875388860989568:0@lo:250: 00000020:00000080:2.0:1788510257.462420:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788510257.462953:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510257.474043:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860989568 00000100:00100000:1.0:1788510257.474060:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860989568 00000100:00100000:1.0:1788510257.474127:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788510257.474134:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e3a8224 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3287:x1875388860989568:12345-0@lo:250: 00010000:00080000:1.0:1788510257.474166:0:5814:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 040cea51-0882-49ef-ac64-3cc6497ba05a@0@lo t0 exp 0000000000000000 cur 115 last 0 00000020:00000080:1.0:1788510257.474242:0:5814:0:(genops.c:1385:class_connect()) connect: client 040cea51-0882-49ef-ac64-3cc6497ba05a, cookie 0x3e734462ed65081 00000100:00080000:1.0:1788510257.474399:0:5814:0:(import.c:65:import_set_state_nolock()) 00000000fe606210 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788510257.474487:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e3a8224 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+5:3287:x1875388860989568:12345-0@lo:250: Request processed in 352us (11536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510257.474494:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510257.474848:0:3287:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788510257.474858:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1788510257.474865:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788510257.474870:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788510257.474873:0:3287:0:(import.c:65:import_set_state_nolock()) 000000007879e715 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788510257.474876:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788510257.474884:0:3287:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788510257.474889:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000243047fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:040cea51-0882-49ef-ac64-3cc6497ba05a:3287:1875388860989568:0@lo:250: 00000100:00100000:2.0:1788510257.497634:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510257.497857:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788510257.497863:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788510257.502952:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788510257.502964:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788510257.527397:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788510257.527923:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788510257.529155:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510257.529450:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788510257.529456:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788510257.530739:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788510257.530749:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788510257.606322:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788510257.608671:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788510257.608976:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788510257.610820:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788510257.610832:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788510257.616679:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510257.616885:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788510257.616892:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788510257.618511:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788510257.618530:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788510257.619547:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510257.619797:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788510257.619802:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788510257.629528:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788510257.629559:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788510257.630977:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510257.631295:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788510257.631301:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788510257.633703:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788510257.633720:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788510257.688559:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510257.688807:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788510257.688815:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788510257.696403:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788510257.696419:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788510257.697898:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788510257.697911:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788510257.699135:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788510257.699161:0:5802:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788510257.699168:0:5802:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788510257.699337:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788510257.699373:0:5802:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.104@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788510257.699378:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788510257.699380:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788510257.699381:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510257.699383:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510257.699384:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510257.699385:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510257.699386:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788510257.699388:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788510257.699389:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788510257.699390:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788510257.699392:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510257.699393:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788510257.699395:0:5802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788510257.699398:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788510257.699403:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788510257.699404:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510257.699405:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510257.699406:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510257.699407:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510257.699407:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788510257.699408:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788510257.699409:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788510257.699410:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788510257.699411:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510257.699411:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788510257.699434:0:5802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788510257.699447:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860989696:0@lo:253: 00000100:00100000:2.0:1788510257.699514:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510257.699543:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e226bcf0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510257.699685:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860989696 00000100:00100000:3.0:1788510257.699694:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860989696 00000100:00100000:3.0:1788510257.699738:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788510257.699747:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7032e64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+5:5802:x1875388860989696:12345-0@lo:253: 20000000:01000000:3.0:1788510257.699792:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788510257.699795:0:5816:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788510257.701491:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788510257.701536:0:5816:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788510257.701825:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788510257.702690:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788510257.703345:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788510257.703349:0:5816:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788510257.703356:0:5816:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788510257.703359:0:5816:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788510257.703375:0:5816:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788510257.703544:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788510257.703701:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788510257.703714:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788510257.703763:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788510257.703827:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788510257.703860:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788510257.703913:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788510257.703918:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788510257.703942:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788510257.703946:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788510257.705337:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788510257.705361:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788510257.705430:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788510257.705481:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788510257.705531:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788510257.705535:0:5816:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788510257.705545:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788510257.705734:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788510257.705746:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788510257.705779:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788510257.705829:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788510257.705880:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788510257.705889:0:5816:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788510257.705936:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788510257.705941:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788510257.707354:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788510257.707414:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788510257.707438:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788510257.707452:0:5816:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788510257.707557:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788510257.707568:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788510257.707599:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788510257.707631:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788510257.707781:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788510257.707826:0:5816:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788510257.707833:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788510257.721473:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788510257.721854:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788510257.721880:0:5816:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.104@tcp for mdt 20000000:01000000:3.0:1788510257.721882:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.104@tcp (null) (null) (null) 00000040:00080000:3.0:1788510257.721904:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788510257.721908:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788510257.721923:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788510257.721927:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.104@tcp (null) (null) 00000040:00080000:3.0:1788510257.721964:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788510257.721974:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788510257.722059:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788510257.722095:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788510257.722155:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788510257.722159:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788510257.722164:0:5816:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788510257.722170:0:5816:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788510257.734353:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1788510257.734705:0:5816:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788510257.747965:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788510257.749620:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788510257.749714:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788510257.749740:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788510257.749743:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788510257.749747:0:5816:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788510257.749765:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788510257.749767:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788510257.749814:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788510257.749818:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788510257.763576:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1788510257.764032:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1788510257.764091:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1788510257.764185:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1788510257.764212:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788510257.764214:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788510257.768890:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788510257.769392:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788510257.769440:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788510257.769472:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788510257.769485:0:5816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788510257.769487:0:5816:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788510257.769495:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788510257.769513:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000040b9e7b6/0x3e734462ed65088 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510257.769530:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040b9e7b6/0x3e734462ed65088 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510257.769539:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000040b9e7b6/0x3e734462ed65088 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510257.769566:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000040b9e7b6/0x3e734462ed65088 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510257.769572:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000040b9e7b6/0x3e734462ed65088 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510257.769579:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000040b9e7b6/0x3e734462ed65088 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510257.769584:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000040b9e7b6 already unused, calling callback (00000000e96bc326) 00010000:00010000:3.0:1788510257.769588:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000040b9e7b6/0x3e734462ed65088 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510257.769595:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000040b9e7b6/0x3e734462ed65088 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510257.769605:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000040b9e7b6/0x3e734462ed65088 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510257.769612:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000040b9e7b6/0x3e734462ed65088 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510257.769618:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000040b9e7b6/0x3e734462ed65088 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788510257.769635:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788510258.024560:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7032e64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+5:5802:x1875388860989696:12345-0@lo:253: Request processed in 324806us (325036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510258.024592:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788510258.024692:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860989696:0@lo:253: 10000000:01000000:2.0:1788510258.024707:0:5802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788510258.024716:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788510258.024718:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788510258.024719:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510258.024720:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788510258.024722:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510258.024723:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510258.024725:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788510258.024726:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788510258.024727:0:5802:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788510258.024729:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510258.024730:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788510258.024749:0:5802:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005b5743f4 from lustre-MDT0000 10000000:01000000:2.0:1788510258.024773:0:5802:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788510258.024776:0:5802:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788510258.024780:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff929a84fbcd40 10000000:01000000:2.0:1788510258.024784:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788510258.024794:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff929a84fbcd40 from 1 10000000:01000000:2.0:1788510258.024796:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788510258.024849:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: 00000000312c21ae/0x3e734462ed6508f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.024858:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: 00000000312c21ae/0x3e734462ed6508f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.024865:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: 00000000312c21ae/0x3e734462ed6508f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510258.024881:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860989824:0@lo:101: 00000100:00100000:2.0:1788510258.024920:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510258.024974:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070f88429 going to sleep for 11 seconds 00000100:00100000:0.0:1788510258.025114:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860989824 00000100:00100000:0.0:1788510258.025128:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860989824 00000100:00100000:0.0:1788510258.025177:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788510258.025184:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036d4d03b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+5:5802:x1875388860989824:12345-0@lo:101: 00010000:00010000:0.0:1788510258.025204:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510258.025219:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000086bbde5/0x3e734462ed65096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6508f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.025274:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000086bbde5/0x3e734462ed65096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6508f expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.025285:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000086bbde5/0x3e734462ed65096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6508f expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.025294:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000086bbde5, rc 0) 00000100:00100000:0.0:1788510258.025326:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036d4d03b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+6:5802:x1875388860989824:12345-0@lo:101: Request processed in 143us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510258.025333:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510258.025482:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860989824:0@lo:101: 00010000:00010000:2.0:1788510258.025492:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: 00000000312c21ae/0x3e734462ed6508f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.025506:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: 00000000312c21ae/0x3e734462ed6508f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510258.025540:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860989952:0@lo:501: 00000100:00100000:2.0:1788510258.025557:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510258.025603:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070f88429 going to sleep for 11 seconds 00000100:00100000:0.0:1788510258.025629:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860989952 00000100:00100000:0.0:1788510258.025632:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860989952 00000100:00100000:0.0:1788510258.025678:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788510258.025685:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000855d7516 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+6:5802:x1875388860989952:12345-0@lo:501: 00000100:00100000:0.0:1788510258.025920:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000855d7516 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+6:5802:x1875388860989952:12345-0@lo:501: Request processed in 236us (362us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788510258.025925:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788510258.026039:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860989952:0@lo:501: 10000000:01000000:2.0:1788510258.026062:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788510258.026081:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: 00000000312c21ae/0x3e734462ed6508f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.026089:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: 00000000312c21ae/0x3e734462ed6508f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510258.026121:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff929a82ae6000 10000000:01000000:2.0:1788510258.026125:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788510258.026128:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff929a82ae6000 10000000:01000000:2.0:1788510258.026131:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788510258.026133:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff929a82ae6000 from 1 10000000:01000000:2.0:1788510258.026135:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788510258.026150:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: 000000009fc2ceac/0x3e734462ed6509d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.026156:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: 000000009fc2ceac/0x3e734462ed6509d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.026163:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: 000000009fc2ceac/0x3e734462ed6509d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510258.026184:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990080:0@lo:101: 00000100:00100000:2.0:1788510258.026218:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510258.026259:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070f88429 going to sleep for 11 seconds 00000100:00100000:0.0:1788510258.026508:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860990080 00000100:00100000:0.0:1788510258.026512:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860990080 00000100:00100000:0.0:1788510258.026565:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788510258.026570:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2807cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+6:5802:x1875388860990080:12345-0@lo:101: 00010000:00010000:0.0:1788510258.026576:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510258.026584:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b99cf3e8/0x3e734462ed650a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6509d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.026593:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b99cf3e8/0x3e734462ed650a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6509d expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.026599:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b99cf3e8/0x3e734462ed650a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6509d expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.026603:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b99cf3e8, rc 0) 00000100:00100000:0.0:1788510258.026629:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2807cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+7:5802:x1875388860990080:12345-0@lo:101: Request processed in 59us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510258.026632:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788510258.026676:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990080:0@lo:101: 00010000:00010000:2.0:1788510258.026685:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: 000000009fc2ceac/0x3e734462ed6509d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.026691:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: 000000009fc2ceac/0x3e734462ed6509d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510258.026701:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788510258.026716:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: 000000009fc2ceac/0x3e734462ed6509d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.026722:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: 000000009fc2ceac/0x3e734462ed6509d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510258.026727:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788510258.026731:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788510258.026735:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff929a82ae6000 10000000:01000000:2.0:1788510258.026737:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788510258.026739:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788510258.026741:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788510258.026754:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: 00000000ca8a4460/0x3e734462ed650ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.026760:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: 00000000ca8a4460/0x3e734462ed650ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.026776:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: 00000000ca8a4460/0x3e734462ed650ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510258.026787:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990208:0@lo:101: 00000100:00100000:2.0:1788510258.026821:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510258.026955:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070f88429 going to sleep for 11 seconds 00000100:00100000:1.0:1788510258.027000:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860990208 00000100:00100000:1.0:1788510258.027004:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860990208 00000100:00100000:1.0:1788510258.027026:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788510258.027032:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df79e726 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+7:5802:x1875388860990208:12345-0@lo:101: 00010000:00010000:1.0:1788510258.027039:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510258.027048:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005dc7164d/0x3e734462ed650b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed650ab expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510258.027063:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005dc7164d/0x3e734462ed650b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed650ab expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510258.027068:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005dc7164d/0x3e734462ed650b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed650ab expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510258.027072:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005dc7164d, rc 0) 00000100:00100000:1.0:1788510258.027101:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df79e726 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+8:5802:x1875388860990208:12345-0@lo:101: Request processed in 70us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510258.027104:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788510258.027169:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990208:0@lo:101: 00010000:00010000:2.0:1788510258.027178:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: 00000000ca8a4460/0x3e734462ed650ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.027185:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: 00000000ca8a4460/0x3e734462ed650ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510258.027252:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990336:0@lo:501: 00000100:00100000:2.0:1788510258.027275:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510258.027294:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070f88429 going to sleep for 11 seconds 00000100:00100000:1.0:1788510258.027408:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860990336 00000100:00100000:1.0:1788510258.027412:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860990336 00000100:00100000:1.0:1788510258.027429:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788510258.027433:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026b5b7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+8:5802:x1875388860990336:12345-0@lo:501: 00000100:00100000:1.0:1788510258.027643:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026b5b7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+9:5802:x1875388860990336:12345-0@lo:501: Request processed in 209us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510258.027649:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788510258.027713:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990336:0@lo:501: 00000100:00100000:2.0:1788510258.027737:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990464:0@lo:503: 00000100:00100000:2.0:1788510258.027771:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510258.027798:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070f88429 going to sleep for 11 seconds 00000100:00100000:1.0:1788510258.027888:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860990464 00000100:00100000:1.0:1788510258.027896:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860990464 00000100:00100000:1.0:1788510258.027908:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788510258.027911:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afa4d34d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+9:5802:x1875388860990464:12345-0@lo:503: 00000100:00100000:1.0:1788510258.028047:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afa4d34d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+9:5802:x1875388860990464:12345-0@lo:503: Request processed in 134us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510258.028054:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788510258.028111:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990464:0@lo:503: 00000100:00100000:3.0:1788510258.028572:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006eaa267c pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:5844:1875388860990592:0@lo:502: 00000100:00100000:3.0:1788510258.028611:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510258.028671:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd541751 going to sleep for 11 seconds 00000100:00100000:1.0:1788510258.028706:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860990592 00000100:00100000:1.0:1788510258.028710:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860990592 00000100:00100000:1.0:1788510258.028742:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788510258.028748:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023a14ca9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+9:5844:x1875388860990592:12345-0@lo:502: 00000100:00100000:1.0:1788510258.029017:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023a14ca9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+9:5844:x1875388860990592:12345-0@lo:502: Request processed in 268us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510258.029025:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788510258.029086:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006eaa267c pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:5844:1875388860990592:0@lo:502: 00000020:01000000:3.0:1788510258.029108:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788510258.029116:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510258.029118:0:5844:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788510258.029124:0:5844:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788510258.029127:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788510258.029141:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000091a796f9) 00000020:00000080:3.0:1788510258.029168:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788510258.029174:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788510258.029259:0:5844:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788510258.029264:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed650c0 00000020:00000080:3.0:1788510258.029482:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788510258.029485:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788510258.029488:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510258.029489:0:5844:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788510258.029490:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788510258.029492:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510258.029493:0:5844:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788510258.029495:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788510258.029500:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d5f327b6) 00000020:00000080:3.0:1788510258.029507:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788510258.029508:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788510258.029509:0:5844:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788510258.029512:0:5844:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788510258.029515:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788510258.029544:0:5844:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005b5743f4 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788510258.029552:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000005839c1cd) 00000020:00000080:3.0:1788510258.029557:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788510258.029587:0:5844:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788510258.029600:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e734462ed650d5 00000020:00000080:3.0:1788510258.029667:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788510258.029671:0:5844:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788510258.029675:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e734462ed650dc 00080000:01000000:3.0:1788510258.029679:0:5844:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788510258.029688:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed650e3 00080000:10000000:3.0:1788510258.030138:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788510258.030565:0:5844:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788510258.034002:0:5844:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788510258.120448:0:5844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788510258.120890:0:5844:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788510258.123794:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788510258.124098:0:5844:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788510258.151891:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000038737341) 00000020:00000080:1.0:1788510258.151909:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788510258.151990:0:5844:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788510258.151998:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed650f1 00000020:00000080:3.0:1788510258.152530:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788510258.158072:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788510258.217615:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788510258.300027:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788510258.349649:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788510258.425262:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788510258.436485:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788510258.488472:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788510258.566603:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e734462ed650f8 00000020:00000080:2.0:1788510258.567259:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788510258.567274:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788510258.567280:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510258.567283:0:5844:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788510258.567296:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788510258.567302:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510258.567303:0:5844:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788510258.567308:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788510258.567352:0:5844:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788510258.567368:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788510258.567371:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510258.567372:0:5844:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788510258.567374:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788510258.567377:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510258.567378:0:5844:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788510258.567381:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788510258.567383:0:5844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788510258.567428:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:5844:1875388860990720:0@lo:502: 00000100:00100000:2.0:1788510258.567518:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510258.567577:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d36b7c98 going to sleep for 11 seconds 00000100:00100000:3.0:1788510258.567654:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860990720 00000100:00100000:3.0:1788510258.567663:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860990720 00000100:00100000:3.0:1788510258.567712:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788510258.567721:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cce59e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+9:5844:x1875388860990720:12345-0@lo:502: 00000100:00100000:3.0:1788510258.568033:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cce59e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+9:5844:x1875388860990720:12345-0@lo:502: Request processed in 313us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510258.568042:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788510258.568324:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:5844:1875388860990720:0@lo:502: 00000020:01000000:2.0:1788510258.568353:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788510258.568358:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510258.568360:0:5844:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788510258.568365:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788510258.568518:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788510258.568538:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788510258.568557:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: 00000000ca8a4460/0x3e734462ed650ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.568567:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: 00000000ca8a4460/0x3e734462ed650ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510258.568575:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff929a82ae6000 from 1 10000000:01000000:0.0:1788510258.568578:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788510258.568618:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.568634:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.568642:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510258.568658:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d2c3c4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990848:0@lo:101: 00000100:00100000:0.0:1788510258.568691:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510258.568725:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078191979 going to sleep for 11 seconds 00000100:00100000:2.0:1788510258.568782:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860990848 00000100:00100000:2.0:1788510258.568787:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860990848 00000100:00100000:2.0:1788510258.568975:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788510258.568983:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000146f73f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+9:5802:x1875388860990848:12345-0@lo:101: 00010000:00010000:2.0:1788510258.568993:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510258.569006:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000745413f6/0x3e734462ed65106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed650ff expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.569025:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000745413f6/0x3e734462ed65106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed650ff expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.569041:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000745413f6/0x3e734462ed65106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed650ff expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.569049:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000745413f6, rc 0) 00000100:00100000:2.0:1788510258.569078:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000146f73f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+10:5802:x1875388860990848:12345-0@lo:101: Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510258.569084:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788510258.571356:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d2c3c4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990848:0@lo:101: 00010000:00010000:0.0:1788510258.571383:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.571395:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510258.571994:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d2c3c4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990976:0@lo:256: 00000100:00100000:0.0:1788510258.572059:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510258.572103:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078191979 going to sleep for 11 seconds 00000100:00100000:0.0:1788510258.572134:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860990976 00000100:00100000:0.0:1788510258.572141:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860990976 00000100:00100000:0.0:1788510258.572211:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788510258.572219:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad19dd3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+10:5802:x1875388860990976:12345-0@lo:256: 20000000:01000000:0.0:1788510258.572267:0:5815:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788510258.572272:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788510258.572340:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad19dd3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+10:5802:x1875388860990976:12345-0@lo:256: Request processed in 123us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510258.572358:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788510258.572397:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d2c3c4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860990976:0@lo:256: 10000000:01000000:0.0:1788510258.572960:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788510258.572975:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.572984:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510258.572991:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929a82ae6000 from 1 10000000:01000000:0.0:1788510258.572994:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788510258.573019:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.573026:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.573034:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510258.573046:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d2c3c4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991104:0@lo:101: 00000100:00100000:0.0:1788510258.573075:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510258.573094:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078191979 going to sleep for 11 seconds 00000100:00100000:0.0:1788510258.573113:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860991104 00000100:00100000:0.0:1788510258.573118:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860991104 00000100:00100000:0.0:1788510258.573140:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788510258.573145:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc0fb5a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+10:5802:x1875388860991104:12345-0@lo:101: 00010000:00010000:0.0:1788510258.573153:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510258.573170:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006fa1f143/0x3e734462ed65114 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6510d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.573201:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006fa1f143/0x3e734462ed65114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6510d expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.573211:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006fa1f143/0x3e734462ed65114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6510d expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.573218:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006fa1f143, rc 0) 00000100:00100000:0.0:1788510258.573267:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc0fb5a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:5802:x1875388860991104:12345-0@lo:101: Request processed in 122us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510258.573273:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788510258.573304:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d2c3c4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991104:0@lo:101: 00010000:00010000:0.0:1788510258.573313:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.573321:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510258.573362:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d2c3c4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991232:0@lo:501: 00000100:00100000:0.0:1788510258.573382:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510258.573393:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078191979 going to sleep for 11 seconds 00000100:00100000:0.0:1788510258.573405:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860991232 00000100:00100000:0.0:1788510258.573408:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860991232 00000100:00100000:0.0:1788510258.573423:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788510258.573428:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009198060e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:5802:x1875388860991232:12345-0@lo:501: 00000100:00100000:0.0:1788510258.573988:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009198060e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:5802:x1875388860991232:12345-0@lo:501: Request processed in 559us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510258.574003:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788510258.574079:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d2c3c4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991232:0@lo:501: 00000100:00100000:0.0:1788510258.574110:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d2c3c4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991360:0@lo:503: 00000100:00100000:0.0:1788510258.574147:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510258.574161:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078191979 going to sleep for 11 seconds 00000100:00100000:0.0:1788510258.574175:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860991360 00000100:00100000:0.0:1788510258.574179:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860991360 00000100:00100000:0.0:1788510258.583399:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788510258.583421:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5850d39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:5802:x1875388860991360:12345-0@lo:503: 00000040:00080000:0.0:1788510258.583487:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788510258.583582:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5850d39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:5802:x1875388860991360:12345-0@lo:503: Request processed in 171us (9434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510258.583589:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788510258.583701:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d2c3c4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991360:0@lo:503: 00000040:00080000:3.0:1788510258.584900:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788510258.585110:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788510258.585134:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788510258.585157:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510258.585193:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510258.585256:0:5802:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788510258.585259:0:5802:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff929a82ae6000 10000000:01000000:1.0:1788510258.585262:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff929a82ae6000 10000000:01000000:1.0:1788510258.585267:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788510258.585273:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff929a82ae6000 from 1 10000000:01000000:1.0:1788510258.585275:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788510258.585322:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: 00000000770f38e8/0x3e734462ed6511b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510258.585328:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: 00000000770f38e8/0x3e734462ed6511b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510258.585339:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: 00000000770f38e8/0x3e734462ed6511b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510258.585360:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9c7f6c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991488:0@lo:101: 00000100:00100000:1.0:1788510258.585412:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510258.592467:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1a4db20 going to sleep for 11 seconds 00000100:00100000:2.0:1788510258.592797:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860991488 00000100:00100000:2.0:1788510258.592807:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860991488 00000100:00100000:2.0:1788510258.593358:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788510258.593368:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7427c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+11:5802:x1875388860991488:12345-0@lo:101: 00010000:00010000:2.0:1788510258.593384:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510258.593414:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c8dd812/0x3e734462ed65122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6511b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.593445:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c8dd812/0x3e734462ed65122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6511b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.593457:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c8dd812/0x3e734462ed65122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6511b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510258.593465:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c8dd812, rc 0) 00000100:00100000:2.0:1788510258.593549:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7427c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5802:x1875388860991488:12345-0@lo:101: Request processed in 181us (8136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510258.593555:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788510258.593927:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9c7f6c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991488:0@lo:101: 00010000:00010000:1.0:1788510258.593945:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: 00000000770f38e8/0x3e734462ed6511b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510258.593954:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: 00000000770f38e8/0x3e734462ed6511b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510258.594038:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9c7f6c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991616:0@lo:501: 00000100:00100000:1.0:1788510258.594069:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510258.594102:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1a4db20 going to sleep for 11 seconds 00000100:00100000:3.0:1788510258.594219:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860991616 00000100:00100000:3.0:1788510258.594239:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860991616 00000100:00100000:3.0:1788510258.594698:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788510258.594707:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f07089b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5802:x1875388860991616:12345-0@lo:501: 00000100:00100000:3.0:1788510258.594980:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f07089b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5802:x1875388860991616:12345-0@lo:501: Request processed in 275us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510258.594988:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788510258.595047:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9c7f6c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991616:0@lo:501: 00000100:00100000:2.0:1788510258.595083:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991744:0@lo:503: 00000100:00100000:2.0:1788510258.595126:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510258.598119:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e226bcf0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510258.598200:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860991744 00000100:00100000:0.0:1788510258.598210:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860991744 00000100:00100000:0.0:1788510258.598285:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788510258.598293:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070339787 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5802:x1875388860991744:12345-0@lo:503: 00000100:00100000:0.0:1788510258.599785:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070339787 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5802:x1875388860991744:12345-0@lo:503: Request processed in 1487us (4652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510258.599797:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788510258.603052:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015e4a9dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860991744:0@lo:503: 00000100:00100000:3.0:1788510258.603602:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006eaa267c pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:5849:1875388860991872:0@lo:502: 00000100:00100000:3.0:1788510258.603685:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510258.603772:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c395cb24 going to sleep for 11 seconds 00000100:00100000:0.0:1788510258.603772:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860991872 00000100:00100000:0.0:1788510258.603779:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860991872 00000100:00100000:0.0:1788510258.603829:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788510258.603838:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a7d9511 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5849:x1875388860991872:12345-0@lo:502: 00000100:00100000:0.0:1788510258.604142:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a7d9511 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5849:x1875388860991872:12345-0@lo:502: Request processed in 305us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510258.604160:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788510258.604604:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006eaa267c pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:5849:1875388860991872:0@lo:502: 00000020:01000004:3.0:1788510258.604665:0:5849:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788510258.604689:0:5849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e148fddd) 00000020:00000080:3.0:1788510258.604708:0:5849:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788510258.604787:0:5849:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005b5743f4 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788510258.604791:0:5849:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005b5743f4 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788510258.604793:0:5849:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005b5743f4 4 00010000:00080000:3.0:1788510258.604829:0:5849:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001a419cab@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.104@tcp at head 00010000:00010000:3.0:1788510258.607016:0:5849:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788510258.611723:0:5849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788510258.611773:0:5849:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788510258.611788:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e734462ed65130 00000100:00080000:3.0:1788510258.612042:0:5849:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788510258.612049:0:5849:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001a419cab using connection 192.168.201.104@tcp/0@lo 00000100:00100000:3.0:1788510258.612157:0:5849:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006eaa267c x1875388860992000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788510258.612257:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006eaa267c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875388860992000:0@lo:38: 00000100:00100000:0.0:1788510258.612330:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510258.612450:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860992000 00000100:00100000:1.0:1788510258.612459:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860992000 00000100:00100000:1.0:1788510258.612491:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788510258.612497:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004acb8c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3287:x1875388860992000:12345-0@lo:38: 00000100:00080000:3.0:1788510258.612576:0:5849:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788510258.614886:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c82deec pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:5849:1875388860992128:0@lo:502: 00000100:00100000:3.0:1788510258.614973:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510258.615016:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860992128 00000100:00100000:3.0:1788510258.615023:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860992128 00000100:00100000:3.0:1788510258.615069:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788510258.615181:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064440168 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5849:x1875388860992128:12345-0@lo:502: 00000100:00100000:3.0:1788510258.615485:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064440168 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5849:x1875388860992128:12345-0@lo:502: Request processed in 408us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510258.615493:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788510258.615539:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2fb30c9 going to sleep for 11 seconds 00000100:00100000:3.0:1788510258.615562:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c82deec pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:5849:1875388860992128:0@lo:502: 00000040:00080000:3.0:1788510258.615585:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:1.0:1788510258.618414:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004acb8c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3287:x1875388860992000:12345-0@lo:38: Request processed in 5724us (5893us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788510258.618431:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1788510258.618474:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788510258.618502:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788510258.618528:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: 00000000770f38e8/0x3e734462ed6511b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510258.618539:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: 00000000770f38e8/0x3e734462ed6511b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788510258.618587:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788510258.618589:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788510258.618590:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788510258.618592:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788510258.618593:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788510258.618594:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788510258.618595:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788510258.618596:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788510258.618598:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788510258.618599:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788510258.618600:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788510258.618602:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788510258.618605:0:5802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788510258.618613:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788510258.618614:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788510258.618615:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788510258.618616:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788510258.618617:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788510258.618618:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788510258.618619:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788510258.618619:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788510258.618620:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788510258.618621:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788510258.618622:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788510258.618622:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788510258.618647:0:5802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788510258.618662:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b3f652f pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860992256:0@lo:253: 00000100:00100000:1.0:1788510258.618724:0:5802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510258.618757:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set 000000008535bc65 going to sleep for 11 seconds 00000100:00100000:1.0:1788510258.618777:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860992256 00000100:00100000:1.0:1788510258.618785:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860992256 00000100:00100000:1.0:1788510258.620995:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788510258.621010:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000198873c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5802:x1875388860992256:12345-0@lo:253: 20000000:01000000:1.0:1788510258.621051:0:5814:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788510258.621073:0:5814:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788510258.623619:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788510258.623634:0:3287:0:(import.c:65:import_set_state_nolock()) 000000001a419cab lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788510258.623641:0:3287:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788510258.623645:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006eaa267c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875388860992000:0@lo:38: 20000000:01000000:1.0:1788510258.672132:0:5814:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788510258.672157:0:5814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788510258.672345:0:5837:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788510258.672351:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788510258.672374:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510258.672394:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000745413f6/0x3e734462ed65106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed650ff expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510258.672402:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510258.672441:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000745413f6/0x3e734462ed65106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed650ff expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510258.672455:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000745413f6/0x3e734462ed65106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed650ff expref: 12 pid: 5814 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510258.672468:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c82deec pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1875388860992384:0@lo:104: 00000100:00100000:3.0:1788510258.672531:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510258.672631:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2fb30c9 going to sleep for 11 seconds 00000100:00100000:0.0:1788510258.672780:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860992384 00000100:00100000:0.0:1788510258.672788:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860992384 00000100:00100000:0.0:1788510258.672852:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510258.672861:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068d8b361 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+3:5837:x1875388860992384:12345-0@lo:104: 00010000:00010000:0.0:1788510258.672873:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.672930:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788510258.672935:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068d8b361 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+3:5837:x1875388860992384:12345-0@lo:104: Request processed in 76us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510258.672942:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788510258.672964:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510258.672969:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.672976:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b0c51051 already unused, calling callback (0000000014ba558e) 10000000:00010000:0.0:1788510258.672979:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.672986:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788510258.673006:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510258.673011:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788510258.673039:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673047:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788510258.673063:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673070:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed650ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65106 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673086:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510258.673087:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510258.673089:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510258.673147:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069da6de9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388860992512:0@lo:103: 00000100:00100000:0.0:1788510258.673177:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510258.673289:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860992512 00000100:00100000:0.0:1788510258.673294:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860992512 00010000:00010000:0.0:1788510258.673309:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000745413f6/0x3e734462ed65106 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed650ff expref: 13 pid: 5814 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510258.673343:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510258.673349:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a4f5d65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:3289:x1875388860992512:12345-0@lo:103: 00010000:00010000:0.0:1788510258.673359:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510258.673363:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000745413f6/0x3e734462ed65106 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed650ff expref: 13 pid: 5814 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673378:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000745413f6/0x3e734462ed65106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed650ff expref: 13 pid: 5814 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673395:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673403:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788510258.673417:0:5806:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001066826s 00010000:00010000:0.0:1788510258.673421:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673427:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673434:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673438:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673443:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000427136f1 already unused, calling callback (00000000e96bc326) 00010000:00010000:0.0:1788510258.673447:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673453:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673461:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673480:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510258.673509:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a4f5d65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:3289:x1875388860992512:12345-0@lo:103: Request processed in 160us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510258.673515:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510258.673551:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069da6de9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388860992512:0@lo:103: 00010000:00010000:0.0:1788510258.673573:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000745413f6/0x3e734462ed65106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed650ff expref: 12 pid: 5814 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510258.673582:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c82deec pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1875388860992384:0@lo:104: 00010000:00010000:0.0:1788510258.673592:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673600:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673604:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510258.673609:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000427136f1/0x3e734462ed65137 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510258.685318:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000198873c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+11:5802:x1875388860992256:12345-0@lo:253: Request processed in 64306us (66586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510258.685402:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788510258.685515:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b3f652f pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:5802:1875388860992256:0@lo:253: 10000000:01000000:2.0:1788510258.685532:0:5802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788510258.685536:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788510258.685537:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788510258.685539:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510258.685540:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510258.685541:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510258.685543:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510258.685544:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788510258.685545:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788510258.685547:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788510258.685548:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788510258.685549:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510258.685551:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788510258.685565:0:5802:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788510258.691265:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510258.691727:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788510258.691987:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510258.692155:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788510258.692607:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510258.692776:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788510258.693641:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510258.693794:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788510258.694095:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510258.694498:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788510258.694750:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510258.695007:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788510258.743647:0:5802:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788510258.780993:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788510258.781297:0:5855:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1788510258.783012:0:5854:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788510258.783019:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788510258.789914:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788510258.790613:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788510258.791076:0:5802:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788510258.791086:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788510258.791287:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788510258.793035:0:5802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788510258.796643:0:5802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788510258.796741:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788510258.799122:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788510258.800400:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788510258.803465:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788510258.803619:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788510258.803759:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788510258.803934:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788510258.804065:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788510258.804266:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788510258.804430:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788510258.804574:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788510258.804724:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788510258.804854:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788510258.805008:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788510258.805142:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788510258.806557:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788510258.806773:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788510258.807007:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788510258.807604:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788510258.808258:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788510258.808914:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788510258.809077:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788510258.809217:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788510258.811706:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788510258.812601:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788510258.812761:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788510258.813109:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788510258.813303:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788510258.813555:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788510258.813724:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788510258.814071:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788510258.814618:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788510258.814761:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788510258.815091:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788510258.815507:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788510258.815736:0:5802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788510258.866564:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788510258.941636:0:5802:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788510258.941676:0:5802:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc1681dcb988 00100000:10000000:2.0:1788510258.941684:0:5802:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788510258.942957:0:5802:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788510258.942973:0:5802:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788510258.942987:0:5802:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788510258.943027:0:5802:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788510259.052765:0:5855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788510259.052851:0:5855:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1788510259.052856:0:5855:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788510259.460464:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510260.486088:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510261.516152:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510262.534577:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788510263.502473:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788510263.502483:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff929a82ae6000 from 3 10000000:01000000:0.0:1788510263.502488:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788510263.502538:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed6513e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510263.502550:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed6513e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510263.502560:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed6513e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510263.502584:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069da6de9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860992640:0@lo:101: 00000100:00100000:0.0:1788510263.502653:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510263.502723:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043b852b5 going to sleep for 11 seconds 00000100:00100000:1.0:1788510263.502784:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860992640 00000100:00100000:1.0:1788510263.502791:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860992640 00000100:00100000:1.0:1788510263.502848:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788510263.502857:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045e6fd93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:5818:x1875388860992640:12345-0@lo:101: 00010000:00010000:1.0:1788510263.502884:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510263.502896:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003a7f4aad/0x3e734462ed65145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6513e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510263.502919:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a7f4aad/0x3e734462ed65145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6513e expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510263.502930:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003a7f4aad/0x3e734462ed65145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6513e expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510263.502940:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003a7f4aad, rc 0) 00000100:00100000:1.0:1788510263.502987:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045e6fd93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5818:x1875388860992640:12345-0@lo:101: Request processed in 132us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510263.502994:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788510263.503127:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069da6de9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860992640:0@lo:101: 00010000:00010000:0.0:1788510263.503143:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed6513e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510263.503153:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed6513e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510263.503204:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069da6de9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860992768:0@lo:256: 00000100:00100000:0.0:1788510263.503268:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510263.503285:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043b852b5 going to sleep for 11 seconds 00000100:00100000:1.0:1788510263.504163:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860992768 00000100:00100000:1.0:1788510263.504172:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860992768 00000100:00100000:1.0:1788510263.504219:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788510263.504245:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac5e7f8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5818:x1875388860992768:12345-0@lo:256: 20000000:01000000:1.0:1788510263.504265:0:5814:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788510263.504281:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788510263.504284:0:5814:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788510263.504404:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac5e7f8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5818:x1875388860992768:12345-0@lo:256: Request processed in 159us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510263.504411:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788510263.504531:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069da6de9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860992768:0@lo:256: 10000000:01000000:2.0:1788510263.504586:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788510263.504594:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed6513e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510263.504603:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: 00000000b0c51051/0x3e734462ed6513e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510263.560605:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788510264.006209:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788510264.006247:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788510264.006252:0:37:0:(import.c:65:import_set_state_nolock()) 000000001a419cab lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788510264.006283:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001a419cab using connection 192.168.201.104@tcp/0@lo 00000100:00100000:0.0:1788510264.006333:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000063aa0fe3 x1875388860992896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788510264.006694:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063aa0fe3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875388860992896:0@lo:38: 00000100:00100000:2.0:1788510264.006778:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510264.014859:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860992896 00000100:00100000:0.0:1788510264.014879:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860992896 00000100:00100000:0.0:1788510264.014941:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788510264.014948:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015e4a9dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3287:x1875388860992896:12345-0@lo:38: 00010000:00080000:0.0:1788510264.014980:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 121 last 0 00000020:00000080:0.0:1788510264.015018:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e734462ed6514c 00000004:00100000:0.0:1788510264.015063:0:5823:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788510264.015210:0:5823:0:(import.c:65:import_set_state_nolock()) 0000000016f84a2a : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788510264.015332:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015e4a9dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875388860992896:12345-0@lo:38: Request processed in 382us (8554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510264.015339:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788510264.015476:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000063aa0fe3 x1875388860992896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788510274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788510264.015493:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788510264.015500:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788510264.015505:0:3287:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788510264.015506:0:3287:0:(import.c:65:import_set_state_nolock()) 000000001a419cab lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788510264.015512:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063aa0fe3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875388860992896:0@lo:38: 00000001:02000400:2.0:1788510264.143534:0:6098:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788510264.580986:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510265.604522:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510266.629836:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510267.656914:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510268.676431:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510269.125877:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccf6b45c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388860993152:0@lo:400: 00000100:00100000:1.0:1788510269.125957:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510269.126032:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510269.126037:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f60fbb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388860993024:0@lo:400: 00000100:00100000:1.0:1788510269.126068:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510269.126106:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860993152 00000100:00100000:1.0:1788510269.126115:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860993152 00000100:00100000:1.0:1788510269.126165:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788510269.126175:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000512d8fdc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388860993152:12345-0@lo:400: 00000100:00100000:1.0:1788510269.126253:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000512d8fdc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388860993152:12345-0@lo:400: Request processed in 80us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510269.126261:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788510269.126301:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ccf6b45c x1875388860993152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510269.126315:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccf6b45c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388860993152:0@lo:400: 00000100:00100000:2.0:1788510269.126791:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860993024 00000100:00100000:2.0:1788510269.126797:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860993024 00000100:00100000:2.0:1788510269.126835:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788510269.126841:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055a454da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:3291:x1875388860993024:12345-0@lo:400: 00000100:00100000:2.0:1788510269.126883:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055a454da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:3291:x1875388860993024:12345-0@lo:400: Request processed in 42us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510269.126897:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788510269.126935:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f60fbb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388860993024:0@lo:400: 00010000:00010000:1.0:1788510269.706380:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788510269.907195:0:6300:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8f2fd530 20000000:00000080:0.0:1788510269.907212:0:6300:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff929aaf746400 uarg=0000000000000000 20000000:01000000:0.0:1788510269.907272:0:6300:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788510269.907279:0:6300:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788510269.907284:0:6300:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788510269.907467:0:6300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788510269.907478:0:6300:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788510269.912372:0:6300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788510269.912617:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788510269.912676:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788510269.912750:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788510269.912769:0:6300:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788510269.913441:0:6300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510269.913472:0:6300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006fa1f143/0x3e734462ed65114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6510d expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510269.913480:0:6300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510269.913516:0:6300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006fa1f143/0x3e734462ed65114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6510d expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510269.913531:0:6300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006fa1f143/0x3e734462ed65114 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6510d expref: 11 pid: 5815 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510269.913545:0:6300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ea9f3c4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6300:1875388860993280:0@lo:104: 00000100:00100000:0.0:1788510269.913672:0:6300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510269.913775:0:6300:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b475ebc going to sleep for 11 seconds 00000100:00100000:3.0:1788510269.914115:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860993280 00000100:00100000:3.0:1788510269.914123:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860993280 00000100:00100000:3.0:1788510269.914208:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788510269.914217:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003878616f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+3:6300:x1875388860993280:12345-0@lo:104: 00010000:00010000:3.0:1788510269.914253:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510269.914326:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788510269.914332:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003878616f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+3:6300:x1875388860993280:12345-0@lo:104: Request processed in 117us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510269.914349:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788510269.914399:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510269.914405:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914412:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008bfc12ce already unused, calling callback (0000000014ba558e) 10000000:00010000:2.0:1788510269.914415:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914422:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788510269.914428:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510269.914433:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788510269.914464:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914471:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788510269.914489:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914495:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: 000000008bfc12ce/0x3e734462ed6510d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65114 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914511:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510269.914513:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510269.914520:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510269.914540:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e151d6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388860993408:0@lo:103: 00000100:00100000:2.0:1788510269.914572:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510269.914629:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860993408 00000100:00100000:2.0:1788510269.914633:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860993408 00010000:00010000:2.0:1788510269.914653:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006fa1f143/0x3e734462ed65114 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6510d expref: 12 pid: 5815 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510269.914674:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788510269.914681:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b10b70c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:3288:x1875388860993408:12345-0@lo:103: 00010000:00010000:2.0:1788510269.914690:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510269.914694:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006fa1f143/0x3e734462ed65114 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6510d expref: 12 pid: 5815 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914703:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006fa1f143/0x3e734462ed65114 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6510d expref: 12 pid: 5815 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914717:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914724:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914735:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914741:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914745:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914760:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914765:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005a5ada3c already unused, calling callback (00000000e96bc326) 00010000:00010000:2.0:1788510269.914768:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914775:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914782:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510269.914791:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510269.914819:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b10b70c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:3288:x1875388860993408:12345-0@lo:103: Request processed in 140us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510269.914826:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788510269.914860:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e151d6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388860993408:0@lo:103: 00010000:00010000:1.0:1788510269.914937:0:6300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006fa1f143/0x3e734462ed65114 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6510d expref: 11 pid: 5815 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510269.914947:0:6300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ea9f3c4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6300:1875388860993280:0@lo:104: 00010000:00010000:1.0:1788510269.914959:0:6300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510269.914966:0:6300:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510269.914971:0:6300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510269.914975:0:6300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005a5ada3c/0x3e734462ed65153 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510270.726877:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788510271.557913:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788510271.557921:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929a82ae6000 from 1 10000000:01000000:2.0:1788510271.557927:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788510271.558012:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: 00000000745413f6/0x3e734462ed6515a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510271.558024:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: 00000000745413f6/0x3e734462ed6515a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510271.558035:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: 00000000745413f6/0x3e734462ed6515a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510271.558077:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e151d6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860993536:0@lo:101: 00000100:00100000:2.0:1788510271.558165:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510271.558271:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000005663c7ba going to sleep for 11 seconds 00000100:00100000:0.0:1788510271.559112:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860993536 00000100:00100000:0.0:1788510271.559124:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860993536 00000100:00100000:0.0:1788510271.559185:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788510271.559193:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b5194e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:5818:x1875388860993536:12345-0@lo:101: 00010000:00010000:0.0:1788510271.559208:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510271.559262:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006fa1f143/0x3e734462ed65161 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6515a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510271.559290:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006fa1f143/0x3e734462ed65161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6515a expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510271.559302:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006fa1f143/0x3e734462ed65161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6515a expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510271.559327:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006fa1f143, rc 0) 00000100:00100000:0.0:1788510271.559384:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b5194e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5818:x1875388860993536:12345-0@lo:101: Request processed in 192us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510271.559390:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788510271.559540:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e151d6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860993536:0@lo:101: 00010000:00010000:1.0:1788510271.559558:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: 00000000745413f6/0x3e734462ed6515a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510271.559566:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: 00000000745413f6/0x3e734462ed6515a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510271.559664:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccf6b45c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860993664:0@lo:501: 00000100:00100000:1.0:1788510271.559697:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510271.559721:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000112553bf going to sleep for 11 seconds 00000100:00100000:0.0:1788510271.560027:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860993664 00000100:00100000:0.0:1788510271.560032:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860993664 00000100:00100000:0.0:1788510271.560069:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788510271.560076:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea2cce7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5818:x1875388860993664:12345-0@lo:501: 00000100:00100000:0.0:1788510271.561870:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea2cce7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5818:x1875388860993664:12345-0@lo:501: Request processed in 1781us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510271.561884:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788510271.571759:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccf6b45c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860993664:0@lo:501: 00000100:00100000:1.0:1788510271.571861:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccf6b45c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860993792:0@lo:503: 00000100:00100000:1.0:1788510271.571948:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510271.572000:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000112553bf going to sleep for 11 seconds 00000100:00100000:0.0:1788510271.572804:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860993792 00000100:00100000:0.0:1788510271.572813:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860993792 00000100:00100000:0.0:1788510271.572881:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788510271.572890:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043d6102c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5818:x1875388860993792:12345-0@lo:503: 00000100:00100000:0.0:1788510271.573112:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043d6102c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5818:x1875388860993792:12345-0@lo:503: Request processed in 223us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510271.573119:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788510271.573652:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccf6b45c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860993792:0@lo:503: 00000100:00100000:1.0:1788510271.574334:0:6360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccf6b45c pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6360:1875388860993920:0@lo:502: 00000100:00100000:1.0:1788510271.574396:0:6360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510271.574430:0:6360:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d271bc72 going to sleep for 11 seconds 00000100:00100000:0.0:1788510271.575349:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860993920 00000100:00100000:0.0:1788510271.575359:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860993920 00000100:00100000:0.0:1788510271.575423:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788510271.575442:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ef20957 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6360:x1875388860993920:12345-0@lo:502: 00000100:00100000:0.0:1788510271.575820:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ef20957 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6360:x1875388860993920:12345-0@lo:502: Request processed in 388us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510271.575829:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788510271.584458:0:6360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccf6b45c pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6360:1875388860993920:0@lo:502: 00000020:01000000:3.0:1788510271.584528:0:6360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788510271.584545:0:6360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510271.584548:0:6360:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788510271.584556:0:6360:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff929a82ae6000 00000020:00000080:3.0:1788510271.584558:0:6360:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788510271.584637:0:6360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6360:1875388860994048:0@lo:502: 00000100:00100000:3.0:1788510271.584724:0:6360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510271.584782:0:6360:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a877b80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510271.585202:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860994048 00000100:00100000:2.0:1788510271.585210:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860994048 00000100:00100000:2.0:1788510271.585283:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788510271.585292:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6360:x1875388860994048:12345-0@lo:502: 00000100:00100000:2.0:1788510271.585539:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6360:x1875388860994048:12345-0@lo:502: Request processed in 247us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510271.585548:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788510271.585832:0:6360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6360:1875388860994048:0@lo:502: 00000020:01000000:3.0:1788510271.585875:0:6360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788510271.585882:0:6360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510271.585884:0:6360:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788510271.585887:0:6360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788510271.586217:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788510271.586281:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788510271.586293:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6515a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510271.586306:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6515a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510271.749650:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510272.781858:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510273.797104:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510274.254170:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788510274.254196:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388860994176:0@lo:400: 00000100:00100000:3.0:1788510274.254293:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510274.254351:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388860994304:0@lo:400: 00000100:00100000:3.0:1788510274.254382:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510274.254419:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860994176 00000100:00100000:3.0:1788510274.254425:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860994176 00000100:00100000:3.0:1788510274.254469:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788510274.254477:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:3288:x1875388860994176:12345-0@lo:400: 00000100:00100000:3.0:1788510274.254528:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:3288:x1875388860994176:12345-0@lo:400: Request processed in 51us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510274.254560:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788510274.254599:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860994304 00000100:00100000:3.0:1788510274.254604:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860994304 00000100:00100000:3.0:1788510274.254631:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788510274.254637:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388860994304:12345-0@lo:400: 00000100:00100000:3.0:1788510274.254673:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388860994304:12345-0@lo:400: Request processed in 36us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510274.254678:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788510274.254713:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff929ab50edf80 x1875388860994304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510274.254725:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388860994304:0@lo:400: 00000100:00100000:3.0:1788510274.254763:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388860994176:0@lo:400: 00010000:00010000:0.0:1788510274.823310:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510275.845484:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510276.868355:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788510277.380918:0:6665:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788510277.380922:0:6665:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788510277.381055:0:6665:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff929ab4b11000 00000020:01000004:1.0:1788510277.381071:0:6665:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788510277.381081:0:6665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788510277.381197:0:6665:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff929aafdc8000) 00000020:00000080:1.0:1788510277.381213:0:6665:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788510277.396606:0:6665:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788510277.396897:0:6665:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788510277.419037:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788510277.424833:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788510277.424879:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788510277.424932:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788510277.424966:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788510277.425564:0:6665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788510277.425582:0:6665:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788510277.425597:0:6665:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e734462ed6516f 00000020:01000004:2.0:1788510277.425606:0:6665:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788510277.425630:0:6665:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788510277.425633:0:6665:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788510277.425639:0:6665:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788510277.425643:0:6665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788510277.425654:0:6665:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff929a84fb8000) 00000020:00000080:2.0:1788510277.425664:0:6665:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788510277.426997:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510277.427173:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788510277.427181:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788510277.435641:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788510277.435658:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788510277.436048:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788510277.436054:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788510277.438169:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510277.438741:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788510277.438748:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788510277.441917:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788510277.441929:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788510277.467606:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510277.467868:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788510277.467876:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788510277.470789:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788510277.470810:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788510277.472754:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788510277.472767:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788510277.475908:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510277.476201:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788510277.476208:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788510277.477169:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788510277.477177:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788510277.523969:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510277.524198:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788510277.524206:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788510277.528614:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788510277.528637:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788510277.529106:0:6665:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788510277.529130:0:6665:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788510277.529136:0:6665:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788510277.548332:0:6665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788510277.548373:0:6665:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.104@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788510277.548378:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788510277.548380:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788510277.548381:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510277.548383:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510277.548384:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510277.548386:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510277.548387:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788510277.548388:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788510277.548389:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788510277.548391:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510277.548392:0:6665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788510277.548396:0:6665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788510277.548398:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788510277.548399:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788510277.548405:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510277.548406:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510277.548407:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510277.548408:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510277.548409:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788510277.548409:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788510277.548410:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788510277.548411:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510277.548412:0:6665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788510277.548442:0:6665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788510277.548461:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860994432:0@lo:253: 00000100:00100000:3.0:1788510277.548603:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510277.548724:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a886853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510277.548818:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860994432 00000100:00100000:0.0:1788510277.548826:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860994432 00000100:00100000:0.0:1788510277.548902:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788510277.548913:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860994432:12345-0@lo:253: 20000000:01000000:0.0:1788510277.548942:0:5814:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788510277.548946:0:5814:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788510277.548951:0:5814:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788510277.548954:0:5814:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788510277.549747:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788510277.549959:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788510277.549975:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788510277.550014:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788510277.550022:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788510277.550054:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788510277.550101:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788510277.550398:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788510277.550417:0:5814:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.104@tcp 20000000:01000000:0.0:1788510277.550419:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788510277.550453:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788510277.550461:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788510277.550590:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788510277.550601:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.104@tcp (null) (null) 00000040:00080000:0.0:1788510277.550635:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788510277.550644:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788510277.550671:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788510277.550720:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788510277.551182:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788510277.551192:0:5814:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.104@tcp 20000000:01000000:0.0:1788510277.551193:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788510277.552691:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788510277.552713:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788510277.552777:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788510277.552786:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.104@tcp (null) (null) 00000040:00080000:0.0:1788510277.552867:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788510277.552879:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788510277.552915:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788510277.552982:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788510277.553004:0:5814:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788510277.553007:0:5814:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788510277.553011:0:5814:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788510277.553027:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788510277.553030:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788510277.553068:0:5814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788510277.553071:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788510277.553948:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788510277.554442:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788510277.554572:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788510277.554647:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788510277.554664:0:5814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788510277.554667:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788510277.555393:0:6681:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788510277.555451:0:6681:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788510277.555578:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788510277.555838:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788510277.555889:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788510277.555946:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788510277.555958:0:5814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788510277.555961:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788510277.556587:0:6682:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1788510277.556631:0:6682:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1788510277.556668:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788510277.556962:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788510277.557005:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788510277.557040:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788510277.557054:0:5814:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788510277.557057:0:5814:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788510277.557066:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788510277.557088:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.557128:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a80030a00/0x3e734462ed65096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6508f expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.557137:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a81678800/0x3e734462ed650b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed650ab expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.557143:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a813fc000/0x3e734462ed65122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6511b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.557151:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.557193:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a813fc000/0x3e734462ed65122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6511b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.557209:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a813fc000/0x3e734462ed65122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6511b expref: 12 pid: 5816 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510277.557451:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1875388860994560:0@lo:104: 00000100:00100000:0.0:1788510277.557603:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788510277.557712:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a81678800/0x3e734462ed650b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed650ab expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.557721:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a81678800/0x3e734462ed650b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed650ab expref: 12 pid: 5814 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510277.557729:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1875388860994688:0@lo:104: 00000100:00100000:0.0:1788510277.557750:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788510277.557829:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a80030a00/0x3e734462ed65096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6508f expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.557845:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a80030a00/0x3e734462ed65096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6508f expref: 12 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510277.557853:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1875388860994816:0@lo:104: 00000100:00100000:0.0:1788510277.557888:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510277.557954:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860994560 00000100:00100000:3.0:1788510277.557962:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860994560 00000100:00100000:3.0:1788510277.558001:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860994688 00000100:00100000:3.0:1788510277.558005:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860994688 00000100:00100000:3.0:1788510277.558019:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788510277.558027:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+4:5814:x1875388860994560:12345-0@lo:104: 00010000:00010000:3.0:1788510277.558039:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed6511b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.558095:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788510277.558100:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+4:5814:x1875388860994560:12345-0@lo:104: Request processed in 75us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510277.558107:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788510277.558124:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788510277.558130:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+3:5814:x1875388860994688:12345-0@lo:104: 00010000:00010000:3.0:1788510277.558138:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a813fc400/0x3e734462ed650ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.558177:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788510277.558188:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+3:5814:x1875388860994688:12345-0@lo:104: Request processed in 58us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510277.558194:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788510277.558274:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788510277.558282:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed6511b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558289:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81679000 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:2.0:1788510277.558294:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed6511b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558302:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed6511b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788510277.558309:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed6511b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510277.558314:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788510277.558348:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed6511b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558365:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788510277.558385:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed6511b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558392:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed6511b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65122 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558404:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510277.558407:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a813fc400/0x3e734462ed650ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558413:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc400 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:2.0:1788510277.558417:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a813fc400/0x3e734462ed650ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558423:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a813fc400/0x3e734462ed650ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788510277.558429:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a813fc400/0x3e734462ed650ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510277.558434:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788510277.558447:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a813fc400/0x3e734462ed650ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558453:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788510277.558468:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a813fc400/0x3e734462ed650ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558484:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a813fc400/0x3e734462ed650ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed650b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558499:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510277.558501:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510277.558503:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510277.558516:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388860994944:0@lo:103: 00000100:00100000:2.0:1788510277.558545:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510277.558588:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388860995072:0@lo:103: 00000100:00100000:2.0:1788510277.558609:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510277.558638:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860994944 00000100:00100000:2.0:1788510277.558641:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860994944 00010000:00010000:2.0:1788510277.558658:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a813fc000/0x3e734462ed65122 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6511b expref: 13 pid: 5816 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510277.558677:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860995072 00000100:00100000:2.0:1788510277.558680:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860995072 00010000:00010000:2.0:1788510277.558691:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a81678800/0x3e734462ed650b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed650ab expref: 14 pid: 5814 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510277.558703:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510277.558708:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:3291:x1875388860994944:12345-0@lo:103: 00010000:00010000:2.0:1788510277.558718:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510277.558723:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a813fc000/0x3e734462ed65122 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6511b expref: 14 pid: 5816 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558732:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a813fc000/0x3e734462ed65122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6511b expref: 14 pid: 5816 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558747:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510277.558774:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:3291:x1875388860994944:12345-0@lo:103: Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510277.558786:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510277.558801:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788510277.558807:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:3288:x1875388860995072:12345-0@lo:103: 00010000:00010000:2.0:1788510277.558814:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510277.558818:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a81678800/0x3e734462ed650b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed650ab expref: 13 pid: 5814 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558826:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a81678800/0x3e734462ed650b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed650ab expref: 13 pid: 5814 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.558836:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510277.558872:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:3288:x1875388860995072:12345-0@lo:103: Request processed in 65us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510277.558878:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788510277.558917:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388860995072:0@lo:103: 00000100:00100000:2.0:1788510277.558940:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388860994944:0@lo:103: 00010000:00010000:0.0:1788510277.559172:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510277.559182:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8686ecc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788510277.559196:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fc000/0x3e734462ed65122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6511b expref: 12 pid: 5816 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510277.559206:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1875388860994560:0@lo:104: 00010000:00010000:0.0:1788510277.559215:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81678800/0x3e734462ed650b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed650ab expref: 11 pid: 5814 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510277.559247:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1875388860994688:0@lo:104: 00000100:00100000:1.0:1788510277.559317:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860994816 00000100:00100000:1.0:1788510277.559322:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860994816 00000100:00100000:3.0:1788510277.559550:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788510277.559559:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+3:5814:x1875388860994816:12345-0@lo:104: 00010000:00010000:3.0:1788510277.559570:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed6508f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.559622:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788510277.559627:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+3:5814:x1875388860994816:12345-0@lo:104: Request processed in 71us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510277.559633:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788510277.559680:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510277.559685:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed6508f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559691:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fcc00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:2.0:1788510277.559694:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed6508f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559701:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed6508f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788510277.559716:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed6508f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510277.559721:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788510277.559750:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed6508f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559755:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788510277.559766:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed6508f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559772:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed6508f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65096 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559784:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510277.559785:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510277.559787:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510277.559796:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388860995200:0@lo:103: 00000100:00100000:2.0:1788510277.559821:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510277.559855:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860995200 00000100:00100000:2.0:1788510277.559871:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860995200 00010000:00010000:2.0:1788510277.559884:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a80030a00/0x3e734462ed65096 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6508f expref: 11 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510277.559900:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788510277.559905:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+11:3289:x1875388860995200:12345-0@lo:103: 00010000:00010000:2.0:1788510277.559913:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510277.559917:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a80030a00/0x3e734462ed65096 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6508f expref: 11 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559931:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a80030a00/0x3e734462ed65096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6508f expref: 11 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559946:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559955:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559968:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559975:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559982:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559988:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.559993:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80030800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510277.559997:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.560004:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.560013:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.560032:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510277.560060:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+11:3289:x1875388860995200:12345-0@lo:103: Request processed in 155us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510277.560066:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788510277.560094:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388860995200:0@lo:103: 00010000:00010000:2.0:1788510277.560117:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80030a00/0x3e734462ed65096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6508f expref: 10 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510277.560126:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1875388860994816:0@lo:104: 00010000:00010000:2.0:1788510277.560142:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.560151:0:5814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.560156:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.560162:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80030800/0x3e734462ed6517d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788510277.560174:0:5814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788510277.620348:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+9:6665:x1875388860994432:12345-0@lo:253: Request processed in 71426us (71734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510277.620364:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788510277.620459:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860994432:0@lo:253: 10000000:01000000:3.0:1788510277.620589:0:6665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788510277.620593:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788510277.620595:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788510277.620596:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510277.620597:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788510277.620599:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510277.620600:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510277.620601:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788510277.620603:0:6665:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788510277.620605:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510277.620606:0:6665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788510277.620625:0:6665:0:(tgt_mount.c:101:server_register_mount()) register mount ffff929ab4b11000 from lustre-OST0000 10000000:01000000:3.0:1788510277.620651:0:6665:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788510277.620654:0:6665:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788510277.620660:0:6665:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff929a84fbcd40 local copy 10000000:01000000:3.0:1788510277.620664:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788510277.620703:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.620729:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.620739:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510277.620757:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860995328:0@lo:101: 00000100:00100000:3.0:1788510277.620874:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510277.621014:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88685180 going to sleep for 11 seconds 00000100:00100000:2.0:1788510277.621092:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860995328 00000100:00100000:2.0:1788510277.621098:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860995328 00000100:00100000:2.0:1788510277.621212:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788510277.621250:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+9:6665:x1875388860995328:12345-0@lo:101: 00010000:00010000:2.0:1788510277.621263:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510277.621278:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fcc00/0x3e734462ed6518b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65184 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.621301:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fcc00/0x3e734462ed6518b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65184 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.621312:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fcc00/0x3e734462ed6518b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65184 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.621321:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fcc00, rc 0) 00000100:00100000:2.0:1788510277.621361:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+10:6665:x1875388860995328:12345-0@lo:101: Request processed in 113us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510277.621367:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788510277.621436:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860995328:0@lo:101: 00010000:00010000:1.0:1788510277.621450:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.621460:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510277.621586:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860995456:0@lo:501: 00000100:00100000:1.0:1788510277.621615:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.621930:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89426e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788510277.622016:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860995456 00000100:00100000:3.0:1788510277.622021:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860995456 00000100:00100000:3.0:1788510277.622045:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788510277.622053:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+10:6665:x1875388860995456:12345-0@lo:501: 00000100:00100000:3.0:1788510277.622278:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+10:6665:x1875388860995456:12345-0@lo:501: Request processed in 226us (661us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788510277.622285:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788510277.623141:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860995456:0@lo:501: 10000000:01000000:1.0:1788510277.623163:0:6665:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788510277.623203:0:6665:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788510277.623210:0:6665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.623219:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.623249:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.623280:0:6665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788510277.623302:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff929ab4b11000 10000000:01000000:1.0:1788510277.623308:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788510277.623338:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff929a84fbcd40 10000000:01000000:1.0:1788510277.623341:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788510277.623344:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff929a84fbcd40 from 1 10000000:01000000:1.0:1788510277.623348:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788510277.623377:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed65192 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.623386:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed65192 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.623397:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed65192 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510277.623414:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860995584:0@lo:101: 00000100:00100000:1.0:1788510277.623459:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.623703:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860995584 00000100:00100000:1.0:1788510277.623709:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860995584 00000100:00100000:1.0:1788510277.623742:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788510277.623750:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+10:6665:x1875388860995584:12345-0@lo:101: 00010000:00010000:1.0:1788510277.623761:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510277.623773:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81678800/0x3e734462ed65199 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65192 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.623918:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510277.623925:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.623933:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81532200 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510277.623937:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.623946:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510277.623954:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510277.623968:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788510277.623990:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.623996:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510277.624015:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.624023:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e734462ed6518b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.624039:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510277.624041:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510277.624043:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510277.624054:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388860995712:0@lo:103: 00000100:00100000:3.0:1788510277.624086:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510277.624135:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860995712 00000100:00100000:3.0:1788510277.624140:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860995712 00000100:00100000:3.0:1788510277.624168:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788510277.624175:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:3290:x1875388860995712:12345-0@lo:103: 00010000:00010000:3.0:1788510277.624185:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510277.624197:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fcc00/0x3e734462ed6518b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed65184 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.624209:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510277.624272:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+11:3290:x1875388860995712:12345-0@lo:103: Request processed in 97us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510277.624279:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788510277.624318:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388860995712:0@lo:103: 00010000:00010000:1.0:1788510277.624384:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81678800/0x3e734462ed65199 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65192 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.624397:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81678800/0x3e734462ed65199 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65192 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.624403:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81678800, rc 0) 00000100:00100000:1.0:1788510277.624436:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+10:6665:x1875388860995584:12345-0@lo:101: Request processed in 686us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510277.624441:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788510277.624546:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89426000 going to sleep for 11 seconds 00000100:00100000:1.0:1788510277.624559:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860995584:0@lo:101: 00010000:00010000:1.0:1788510277.624571:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed65192 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65199 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.624580:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed65192 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65199 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510277.624594:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788510277.624612:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed65192 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65199 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.624620:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed65192 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65199 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510277.624626:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788510277.624632:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788510277.624636:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788510277.624639:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788510277.624655:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.624662:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.624670:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510277.624692:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860995840:0@lo:101: 00000100:00100000:1.0:1788510277.624717:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.624737:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860995840 00000100:00100000:1.0:1788510277.624741:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860995840 00000100:00100000:1.0:1788510277.624760:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788510277.624766:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+10:6665:x1875388860995840:12345-0@lo:101: 00010000:00010000:1.0:1788510277.624773:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510277.624782:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81679200/0x3e734462ed651a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed651a0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.624916:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81679200/0x3e734462ed651a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed651a0 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.624924:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81679200/0x3e734462ed651a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed651a0 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.624931:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81679200, rc 0) 00000100:00100000:1.0:1788510277.624958:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:6665:x1875388860995840:12345-0@lo:101: Request processed in 191us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510277.624964:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788510277.624986:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89426000 going to sleep for 11 seconds 00000100:00100000:1.0:1788510277.624997:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860995840:0@lo:101: 00010000:00010000:1.0:1788510277.625007:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.625014:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510277.625099:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860995968:0@lo:501: 00000100:00100000:1.0:1788510277.625120:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.625137:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860995968 00000100:00100000:1.0:1788510277.625140:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860995968 00000100:00100000:1.0:1788510277.625154:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788510277.625158:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:6665:x1875388860995968:12345-0@lo:501: 00000100:00100000:1.0:1788510277.625378:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:6665:x1875388860995968:12345-0@lo:501: Request processed in 218us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510277.625386:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788510277.625409:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89426000 going to sleep for 11 seconds 00000100:00100000:1.0:1788510277.625420:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860995968:0@lo:501: 00000100:00100000:1.0:1788510277.625446:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996096:0@lo:503: 00000100:00100000:1.0:1788510277.625556:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.625577:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860996096 00000100:00100000:1.0:1788510277.625581:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860996096 00000100:00100000:1.0:1788510277.625600:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788510277.625605:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:6665:x1875388860996096:12345-0@lo:503: 00000100:00100000:1.0:1788510277.625734:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:6665:x1875388860996096:12345-0@lo:503: Request processed in 129us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510277.625741:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788510277.625772:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89426000 going to sleep for 11 seconds 00000100:00100000:1.0:1788510277.626069:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996096:0@lo:503: 00000040:00080000:1.0:1788510277.626457:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788510277.626609:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996224:0@lo:502: 00000100:00100000:1.0:1788510277.626654:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.626719:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a874003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510277.626806:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860996224 00000100:00100000:2.0:1788510277.626812:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860996224 00000100:00100000:1.0:1788510277.627052:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788510277.627062:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+11:6665:x1875388860996224:12345-0@lo:502: 00000100:00100000:1.0:1788510277.627246:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+11:6665:x1875388860996224:12345-0@lo:502: Request processed in 185us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510277.627253:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788510277.627395:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996224:0@lo:502: 00000040:00080000:0.0:1788510277.627652:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788510277.627704:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788510277.627741:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788510277.627909:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788510277.627946:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788510277.627970:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788510277.627996:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996352:0@lo:502: 00000100:00100000:0.0:1788510277.628035:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510277.628070:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510277.628147:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860996352 00000100:00100000:2.0:1788510277.628152:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860996352 00000100:00100000:2.0:1788510277.628178:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788510277.628185:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+11:6665:x1875388860996352:12345-0@lo:502: 00000100:00100000:2.0:1788510277.628351:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+11:6665:x1875388860996352:12345-0@lo:502: Request processed in 165us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510277.628358:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788510277.628544:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996352:0@lo:502: 00000040:00080000:0.0:1788510277.628626:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788510277.628643:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788510277.629296:0:6683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788510277.629306:0:6683:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788510277.629314:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510277.629317:0:6683:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788510277.629323:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788510277.629354:0:6683:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9299811ab380) 00000020:00000080:2.0:1788510277.629377:0:6683:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788510277.629385:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788510277.629445:0:6683:0:(tgt_mount.c:153:server_get_mount()) get mount ffff929ab4b11000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788510277.629452:0:6683:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788510277.629458:0:6683:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e734462ed651b5 00010000:00010000:2.0:1788510277.636000:0:6683:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788510277.636378:0:6683:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788510277.639354:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788510277.639639:0:6683:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788510277.645703:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788510277.646763:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788510277.648301:0:6683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788510277.648315:0:6683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788510277.648321:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510277.648324:0:6683:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788510277.648327:0:6683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788510277.648332:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510277.648333:0:6683:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788510277.648337:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788510277.648339:0:6683:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788510277.648396:0:6683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788510277.648399:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510277.648401:0:6683:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788510277.648404:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788510277.648568:0:6665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788510277.648594:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788510277.648612:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.648623:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510277.648631:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929ab4b11000 from 1 10000000:01000000:1.0:1788510277.648634:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788510277.648671:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.648681:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.648693:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510277.648717:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996480:0@lo:101: 00000100:00100000:1.0:1788510277.648802:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.648849:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510277.649033:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860996480 00000100:00100000:2.0:1788510277.649042:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860996480 00000100:00100000:2.0:1788510277.649091:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788510277.649101:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+11:6665:x1875388860996480:12345-0@lo:101: 00010000:00010000:2.0:1788510277.649115:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510277.649129:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fc400/0x3e734462ed651c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed651bc expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.649167:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fc400/0x3e734462ed651c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed651bc expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.649179:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fc400/0x3e734462ed651c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed651bc expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.649189:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fc400, rc 0) 00000100:00100000:2.0:1788510277.649255:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860996480:12345-0@lo:101: Request processed in 155us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510277.649262:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788510277.649432:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996480:0@lo:101: 00010000:00010000:1.0:1788510277.649447:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.649457:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510277.649639:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996608:0@lo:501: 00000100:00100000:1.0:1788510277.649669:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.649700:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510277.649947:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860996608 00000100:00100000:2.0:1788510277.649952:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860996608 00000100:00100000:2.0:1788510277.649988:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788510277.649996:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860996608:12345-0@lo:501: 00000100:00100000:2.0:1788510277.650261:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860996608:12345-0@lo:501: Request processed in 265us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510277.650268:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788510277.650388:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996608:0@lo:501: 00000100:00100000:1.0:1788510277.650418:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996736:0@lo:503: 00000100:00100000:1.0:1788510277.651901:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.651986:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788510277.654291:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860996736 00000100:00100000:0.0:1788510277.654305:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860996736 00000100:00100000:0.0:1788510277.654355:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788510277.654365:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860996736:12345-0@lo:503: 00000100:00100000:0.0:1788510277.654775:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860996736:12345-0@lo:503: Request processed in 410us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510277.654910:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996736:0@lo:503: 00000040:00080000:1.0:1788510277.655204:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788510277.655329:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996864:0@lo:502: 00000100:00100000:1.0:1788510277.655388:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.655427:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788510277.655585:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788510277.655625:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860996864 00000100:00100000:0.0:1788510277.655629:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860996864 00000100:00100000:0.0:1788510277.655655:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788510277.655662:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860996864:12345-0@lo:502: 00000100:00100000:0.0:1788510277.655917:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860996864:12345-0@lo:502: Request processed in 255us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510277.655924:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788510277.656007:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996864:0@lo:502: 00000040:00080000:3.0:1788510277.656304:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788510277.656354:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788510277.656382:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996992:0@lo:502: 00000100:00100000:3.0:1788510277.656420:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510277.656438:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a886859c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510277.656566:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860996992 00000100:00100000:0.0:1788510277.656572:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860996992 00000100:00100000:0.0:1788510277.656600:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788510277.656607:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860996992:12345-0@lo:502: 00000100:00100000:0.0:1788510277.656740:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860996992:12345-0@lo:502: Request processed in 133us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510277.656747:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788510277.656945:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860996992:0@lo:502: 00000040:00080000:3.0:1788510277.657025:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788510277.657035:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788510277.657945:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788510277.657955:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510277.657958:0:6687:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788510277.657965:0:6687:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff929ab4b11000 00000020:00000080:0.0:1788510277.657968:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788510277.657986:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788510277.657990:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510277.657998:0:6687:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788510277.658001:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788510277.658360:0:6665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788510277.658380:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788510277.658394:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.658405:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510277.658453:0:6665:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788510277.658456:0:6665:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff929ab4b11000 10000000:01000000:1.0:1788510277.658459:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff929ab4b11000 10000000:01000000:1.0:1788510277.658463:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788510277.658468:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff929ab4b11000 from 1 10000000:01000000:1.0:1788510277.658539:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788510277.658574:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.658583:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.658593:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510277.658612:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860997120:0@lo:101: 00000100:00100000:1.0:1788510277.658668:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.658696:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510277.658909:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860997120 00000100:00100000:0.0:1788510277.658916:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860997120 00000100:00100000:0.0:1788510277.658955:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788510277.658963:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860997120:12345-0@lo:101: 00010000:00010000:0.0:1788510277.658974:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510277.658988:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a80030800/0x3e734462ed651d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed651ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.659010:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80030800/0x3e734462ed651d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed651ca expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.659021:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a80030800/0x3e734462ed651d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed651ca expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.659029:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a80030800, rc 0) 00000100:00100000:0.0:1788510277.659074:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6665:x1875388860997120:12345-0@lo:101: Request processed in 111us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510277.659081:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788510277.659629:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860997120:0@lo:101: 00010000:00010000:3.0:1788510277.659646:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.659656:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510277.659749:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860997248:0@lo:501: 00000100:00100000:3.0:1788510277.659779:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510277.659930:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a886859c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788510277.659981:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860997248 00000100:00100000:1.0:1788510277.659986:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860997248 00000100:00100000:1.0:1788510277.660023:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788510277.660031:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6665:x1875388860997248:12345-0@lo:501: 00000100:00100000:1.0:1788510277.660261:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6665:x1875388860997248:12345-0@lo:501: Request processed in 230us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510277.660269:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788510277.660602:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860997248:0@lo:501: 00000100:00100000:3.0:1788510277.660634:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860997376:0@lo:503: 00000100:00100000:3.0:1788510277.660667:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510277.660684:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a886859c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788510277.661572:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860997376 00000100:00100000:1.0:1788510277.661579:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860997376 00000100:00100000:1.0:1788510277.661621:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788510277.661636:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6665:x1875388860997376:12345-0@lo:503: 00000100:00100000:1.0:1788510277.662405:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6665:x1875388860997376:12345-0@lo:503: Request processed in 766us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510277.662414:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788510277.664601:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860997376:0@lo:503: 00000040:00080000:0.0:1788510277.665111:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788510277.665190:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860997504:0@lo:502: 00000100:00100000:0.0:1788510277.665299:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510277.665401:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788510277.666131:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860997504 00000100:00100000:1.0:1788510277.666140:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860997504 00000100:00100000:1.0:1788510277.666253:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788510277.666264:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6665:x1875388860997504:12345-0@lo:502: 00000100:00100000:1.0:1788510277.666708:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6665:x1875388860997504:12345-0@lo:502: Request processed in 445us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510277.666716:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788510277.666806:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860997504:0@lo:502: 00000040:00080000:2.0:1788510277.667093:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788510277.667143:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788510277.667178:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788510277.667268:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788510277.667306:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788510277.667367:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788510277.667408:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788510277.667441:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788510277.667506:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788510277.667543:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788510277.667587:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788510277.667636:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788510277.667670:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788510277.667702:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788510277.667747:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788510277.667781:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788510277.667811:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788510277.667852:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788510277.667902:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788510277.667956:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788510277.668019:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788510277.668058:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788510277.668093:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788510277.668140:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788510277.668177:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788510277.668210:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788510277.668292:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788510277.668330:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788510277.668375:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860997632:0@lo:502: 00000100:00100000:2.0:1788510277.668447:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510277.668978:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4b2a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788510277.669013:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860997632 00000100:00100000:0.0:1788510277.669021:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860997632 00000100:00100000:1.0:1788510277.669087:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788510277.669102:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6665:x1875388860997632:12345-0@lo:502: 00000100:00100000:1.0:1788510277.669391:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6665:x1875388860997632:12345-0@lo:502: Request processed in 293us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510277.669399:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788510277.669535:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860997632:0@lo:502: 00000040:00080000:2.0:1788510277.669636:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788510277.669650:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788510277.670547:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788510277.670571:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff929981854d40) 00000020:00000080:0.0:1788510277.670595:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788510277.670674:0:6688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff929ab4b11000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788510277.670679:0:6688:0:(tgt_mount.c:187:server_put_mount()) put mount ffff929ab4b11000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788510277.670681:0:6688:0:(obd_mount.c:710:lustre_put_lsi()) put ffff929ab4b11000 3 00010000:00080000:0.0:1788510277.670709:0:6688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92998185f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.104@tcp at head 00010000:00010000:0.0:1788510277.672991:0:6688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788510277.673294:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788510277.673331:0:6688:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788510277.673342:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3e734462ed651df 00000100:00080000:0.0:1788510277.673353:0:6688:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788510277.673359:0:6688:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92998185f000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:0.0:1788510277.673396:0:6688:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929abaf23b80 x1875388860997760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788510277.673419:0:6688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788510277.673714:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388860997888:0@lo:400: 00000100:00100000:1.0:1788510277.673880:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510277.673984:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860997888 00000100:00100000:0.0:1788510277.673992:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860997888 00000100:00100000:0.0:1788510277.674043:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788510277.674053:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388860997888:12345-0@lo:400: 00000100:00100000:0.0:1788510277.674108:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388860997888:12345-0@lo:400: Request processed in 56us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510277.674114:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510277.674264:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1875388860997760:0@lo:38: 00000100:00100000:2.0:1788510277.674299:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510277.674394:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860997760 00000100:00100000:0.0:1788510277.674399:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860997760 00000100:00100000:0.0:1788510277.674426:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788510277.674431:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3287:x1875388860997760:12345-0@lo:38: 00010000:00080000:0.0:1788510277.674450:0:5821:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:0.0:1788510277.674492:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e734462ed651e6 00000004:00100000:0.0:1788510277.674506:0:5821:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788510277.674542:0:5821:0:(import.c:65:import_set_state_nolock()) ffff92998185a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788510277.674577:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875388860997760:12345-0@lo:38: Request processed in 145us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510277.674584:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1788510277.674702:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:2.0:1788510277.674963:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff929abaf23b80 x1875388860997760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788510287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510277.674973:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788510277.674981:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788510277.674994:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788510277.674998:0:3287:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788510277.675000:0:3287:0:(import.c:65:import_set_state_nolock()) ffff92998185f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788510277.675006:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1875388860997760:0@lo:38: 00010000:00080000:1.0:1788510277.675156:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff929ab4e99180 x1875388860997888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510277.675167:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388860997888:0@lo:400: 00000020:01000000:1.0:1788510277.675186:0:6665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788510277.675211:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788510277.675302:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.675324:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788510277.675369:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788510277.675371:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788510277.675372:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788510277.675373:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788510277.675375:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788510277.675381:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788510277.675382:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788510277.675383:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788510277.675385:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788510277.675387:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788510277.675388:0:6665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788510277.675392:0:6665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788510277.675394:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788510277.675396:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788510277.675397:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788510277.675398:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788510277.675399:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788510277.675400:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788510277.675401:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788510277.675402:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788510277.675403:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788510277.675405:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788510277.675406:0:6665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788510277.675424:0:6665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788510277.675435:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860998016:0@lo:253: 00000100:00100000:1.0:1788510277.675586:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.675648:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788510277.675690:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860998016 00000100:00100000:0.0:1788510277.675696:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860998016 00000100:00100000:0.0:1788510277.675768:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788510277.675777:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6665:x1875388860998016:12345-0@lo:253: 20000000:01000000:0.0:1788510277.675879:0:5816:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788510277.675893:0:5816:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788510277.702745:0:5816:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788510277.702771:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788510277.702952:0:5837:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788510277.702958:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788510277.703000:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.703025:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a81679e00/0x3e734462ed65145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6513e expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.703035:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.703081:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a81679e00/0x3e734462ed65145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6513e expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510277.703096:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a81679e00/0x3e734462ed65145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6513e expref: 13 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510277.703111:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1875388860998144:0@lo:104: 00000100:00100000:3.0:1788510277.703177:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510277.703268:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff92998183fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788510277.704008:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860998144 00000100:00100000:0.0:1788510277.704019:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860998144 00000100:00100000:0.0:1788510277.704072:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788510277.704083:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+3:5837:x1875388860998144:12345-0@lo:104: 00010000:00010000:0.0:1788510277.704100:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6513e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.704164:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788510277.704170:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+3:5837:x1875388860998144:12345-0@lo:104: Request processed in 90us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510277.704176:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788510277.704244:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1875388860998144:0@lo:104: 00010000:00010000:0.0:1788510277.704267:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.704653:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510277.704661:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6513e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.704669:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80031400 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:2.0:1788510277.704674:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6513e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.704682:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6513e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788510277.704689:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6513e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510277.704695:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788510277.704739:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6513e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.704747:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788510277.704777:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6513e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.704906:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6513e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65145 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510277.704925:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510277.704941:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510277.704943:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510277.704956:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788510277.704969:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388860998272:0@lo:103: 00000100:00100000:2.0:1788510277.705012:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510277.706584:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860998272 00000100:00100000:1.0:1788510277.706602:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860998272 00010000:00010000:1.0:1788510277.706643:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a81679e00/0x3e734462ed65145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6513e expref: 14 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510277.706703:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788510277.706714:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87751050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:3289:x1875388860998272:12345-0@lo:103: 00010000:00010000:1.0:1788510277.706731:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510277.706737:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a81679e00/0x3e734462ed65145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6513e expref: 14 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.706750:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a81679e00/0x3e734462ed65145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6513e expref: 14 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.706770:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81679e00/0x3e734462ed65145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6513e expref: 14 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.706902:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.706912:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788510277.706931:0:5807:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003974431s 00010000:00010000:1.0:1788510277.706937:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.706943:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.706951:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.706957:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.706972:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81532200 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510277.706976:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.706985:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.707005:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510277.707016:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510277.707085:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87751050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:3289:x1875388860998272:12345-0@lo:103: Request processed in 373us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510277.707093:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788510277.707201:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388860998272:0@lo:103: 00010000:00010000:0.0:1788510277.707400:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.707415:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510277.707422:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81532200/0x3e734462ed651ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510277.714509:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:6665:x1875388860998016:12345-0@lo:253: Request processed in 38723us (38913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510277.714524:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788510277.714653:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:6665:1875388860998016:0@lo:253: 10000000:01000000:1.0:1788510277.714670:0:6665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788510277.714673:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788510277.714675:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788510277.714676:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788510277.714677:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788510277.714678:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788510277.714679:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788510277.714681:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788510277.714683:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788510277.714684:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788510277.714686:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788510277.714688:0:6665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788510277.714702:0:6665:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788510277.719720:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788510277.720000:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788510277.720218:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788510277.720638:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788510277.721040:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788510277.721313:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788510277.723003:0:6665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788510277.896937:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788510278.074487:0:6665:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788510278.074494:0:6665:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788510278.074523:0:6665:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788510278.074584:0:6665:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788510278.074600:0:6665:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788510278.074629:0:6665:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788510278.917440:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788510278.981715:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788510278.981721:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff929a82ae6000 from 21 10000000:01000000:1.0:1788510278.981726:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788510278.981765:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510278.981777:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510278.981789:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510278.981814:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860998400:0@lo:101: 00000100:00100000:1.0:1788510278.981913:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510278.982082:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860998400 00000100:00100000:3.0:1788510278.982089:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860998400 00000100:00100000:3.0:1788510278.982137:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788510278.982146:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5818:x1875388860998400:12345-0@lo:101: 00010000:00010000:3.0:1788510278.982158:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510278.982171:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81533200/0x3e734462ed651fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed651f4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510278.982207:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81533200/0x3e734462ed651fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed651f4 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510278.982218:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81533200/0x3e734462ed651fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed651f4 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510278.982245:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81533200, rc 0) 00000100:00100000:3.0:1788510278.982283:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388860998400:12345-0@lo:101: Request processed in 138us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510278.982289:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788510278.982968:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aaf3e06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788510278.982995:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860998400:0@lo:101: 00010000:00010000:1.0:1788510278.983012:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510278.983022:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510278.983080:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860998528:0@lo:501: 00000100:00100000:1.0:1788510278.983110:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510278.983150:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aaf3e06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788510278.983170:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860998528 00000100:00100000:1.0:1788510278.983175:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860998528 00000100:00100000:1.0:1788510278.983207:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788510278.983214:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388860998528:12345-0@lo:501: 00000100:00100000:1.0:1788510278.983869:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388860998528:12345-0@lo:501: Request processed in 654us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510278.983878:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788510278.983923:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860998528:0@lo:501: 00000100:00100000:1.0:1788510278.984078:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860998656:0@lo:503: 00000100:00100000:1.0:1788510278.984117:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510278.984139:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aaf3e06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788510278.984152:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860998656 00000100:00100000:1.0:1788510278.984156:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860998656 00000100:00100000:1.0:1788510278.984181:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788510278.984188:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388860998656:12345-0@lo:503: 00000100:00100000:1.0:1788510278.986265:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388860998656:12345-0@lo:503: Request processed in 2070us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510278.986277:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788510278.996616:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860998656:0@lo:503: 00000100:00100000:2.0:1788510278.997844:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89045500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6721:1875388860998784:0@lo:502: 00000100:00100000:2.0:1788510278.997920:0:6721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510278.997966:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4b2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788510278.998012:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860998784 00000100:00100000:0.0:1788510278.998019:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860998784 00000100:00100000:0.0:1788510278.998069:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788510278.998078:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6721:x1875388860998784:12345-0@lo:502: 00000100:00100000:0.0:1788510278.998388:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6721:x1875388860998784:12345-0@lo:502: Request processed in 310us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510278.998396:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788510278.998516:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89045500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6721:1875388860998784:0@lo:502: 00000100:00100000:2.0:1788510278.998566:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89045500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6721:1875388860998912:0@lo:502: 00000100:00100000:2.0:1788510278.998602:0:6721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510278.998626:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4b2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788510278.998725:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860998912 00000100:00100000:0.0:1788510278.998731:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860998912 00000100:00100000:0.0:1788510278.998765:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788510278.998774:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6721:x1875388860998912:12345-0@lo:502: 00000100:00100000:0.0:1788510278.998913:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:6721:x1875388860998912:12345-0@lo:502: Request processed in 140us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510278.998920:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788510279.001380:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89045500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6721:1875388860998912:0@lo:502: 00000040:00080000:2.0:1788510279.001437:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788510279.001986:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788510279.002007:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788510279.002019:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510279.002040:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510279.002050:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788510279.002053:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff929a82ae6000 from 4 10000000:01000000:0.0:1788510279.002056:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788510279.002095:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510279.002102:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510279.002112:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510279.002131:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860999040:0@lo:101: 00000100:00100000:0.0:1788510279.002190:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510279.002263:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788510279.002670:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860999040 00000100:00100000:2.0:1788510279.002679:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860999040 00000100:00100000:2.0:1788510279.002735:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788510279.002746:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388860999040:12345-0@lo:101: 00010000:00010000:2.0:1788510279.002759:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510279.002773:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fd000/0x3e734462ed65209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65202 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510279.002800:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fd000/0x3e734462ed65209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65202 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510279.002811:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fd000/0x3e734462ed65209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65202 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510279.002829:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fd000, rc 0) 00000100:00100000:2.0:1788510279.002884:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388860999040:12345-0@lo:101: Request processed in 140us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510279.002891:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788510279.003329:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860999040:0@lo:101: 00010000:00010000:0.0:1788510279.003344:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510279.003354:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510279.003406:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860999168:0@lo:256: 00000100:00100000:0.0:1788510279.003441:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510279.003629:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788510279.005812:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860999168 00000100:00100000:1.0:1788510279.005827:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860999168 00000100:00100000:1.0:1788510279.006764:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788510279.006775:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388860999168:12345-0@lo:256: 20000000:01000000:1.0:1788510279.006801:0:5816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788510279.006822:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788510279.006825:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788510279.006963:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388860999168:12345-0@lo:256: Request processed in 190us (3521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510279.006976:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788510279.008355:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860999168:0@lo:256: 10000000:01000000:0.0:1788510279.008422:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788510279.008434:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510279.008447:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510279.008456:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788510279.008459:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788510279.008462:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788510279.008512:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510279.008521:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510279.008530:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510279.008549:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860999296:0@lo:101: 00000100:00100000:0.0:1788510279.008604:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510279.008657:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788510279.009464:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860999296 00000100:00100000:3.0:1788510279.009485:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860999296 00000100:00100000:3.0:1788510279.009536:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788510279.009546:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388860999296:12345-0@lo:101: 00010000:00010000:3.0:1788510279.009560:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510279.009575:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81533a00/0x3e734462ed65217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65210 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.009598:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81533a00/0x3e734462ed65217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65210 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.009609:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81533a00/0x3e734462ed65217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65210 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.009619:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81533a00, rc 0) 00000100:00100000:3.0:1788510279.009672:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388860999296:12345-0@lo:101: Request processed in 127us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510279.009679:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788510279.009747:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860999296:0@lo:101: 00010000:00010000:3.0:1788510279.009764:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.009774:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510279.009845:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860999424:0@lo:501: 00000100:00100000:3.0:1788510279.009879:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510279.009895:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff92998183fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510279.009906:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860999424 00000100:00100000:3.0:1788510279.009910:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860999424 00000100:00100000:3.0:1788510279.009926:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788510279.009932:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388860999424:12345-0@lo:501: 00000100:00100000:3.0:1788510279.010180:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388860999424:12345-0@lo:501: Request processed in 247us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510279.010187:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788510279.010215:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860999424:0@lo:501: 00000100:00100000:3.0:1788510279.010269:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860999552:0@lo:503: 00000100:00100000:3.0:1788510279.010303:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510279.010315:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff92998183fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510279.010325:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860999552 00000100:00100000:3.0:1788510279.010328:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860999552 00000100:00100000:3.0:1788510279.010343:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788510279.010348:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388860999552:12345-0@lo:503: 00000100:00100000:3.0:1788510279.010610:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388860999552:12345-0@lo:503: Request processed in 260us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510279.010627:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788510279.010664:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388860999552:0@lo:503: 00000100:00100000:3.0:1788510279.010858:0:6722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6722:1875388860999680:0@lo:502: 00000100:00100000:3.0:1788510279.010890:0:6722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510279.010908:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860999680 00000100:00100000:3.0:1788510279.010912:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860999680 00000100:00100000:3.0:1788510279.010931:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788510279.010936:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:6722:x1875388860999680:12345-0@lo:502: 00000100:00100000:3.0:1788510279.011103:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:6722:x1875388860999680:12345-0@lo:502: Request processed in 165us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510279.011109:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788510279.011137:0:6722:0:(client.c:2716:ptlrpc_set_wait()) set ffff92998183f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788510279.011148:0:6722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6722:1875388860999680:0@lo:502: 00000020:01000000:3.0:1788510279.011169:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788510279.011177:0:6722:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788510279.011183:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510279.011186:0:6722:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788510279.011192:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788510279.011196:0:6722:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.104@tcp to nid 0x20000c0a8c968 (192.168.201.104@tcp) 00000020:01000000:3.0:1788510279.011217:0:6722:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788510279.011244:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788510279.011259:0:6722:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff929ab4e84d40) 00000020:00000080:3.0:1788510279.011281:0:6722:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788510279.011287:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788510279.011355:0:6722:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788510279.011361:0:6722:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788510279.011367:0:6722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed65225 00010000:00080000:3.0:1788510279.011403:0:6722:0:(ldlm_lib.c:102:import_set_conn()) imp ffff929a85c6e800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.104@tcp at head 00010000:00010000:3.0:1788510279.011633:0:6722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788510279.072777:0:6722:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788510279.072799:0:6722:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788510279.073421:0:6722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788510279.073678:0:6722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788510279.073720:0:6722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788510279.073768:0:6722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788510279.074160:0:6724:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788510279.074165:0:6724:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788510279.075386:0:6722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788510279.075400:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788510279.075559:0:6722:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788510279.075586:0:6722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e734462ed6522c 00000100:00080000:0.0:1788510279.075597:0:6722:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788510279.075603:0:6722:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff929a85c6e800 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:0.0:1788510279.075639:0:6722:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929abaf22680 x1875388860999808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788510279.075704:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388860999808:0@lo:8: 00000100:00100000:2.0:1788510279.075771:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510279.075875:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860999808 00000100:00100000:1.0:1788510279.075883:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860999808 00000100:00100000:1.0:1788510279.075930:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788510279.075938:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3287:x1875388860999808:12345-0@lo:8: 00010000:00080000:1.0:1788510279.075965:0:6667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 136 last 0 00000020:00000080:1.0:1788510279.075989:0:6667:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e734462ed65233 00002000:00100000:1.0:1788510279.076018:0:6667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9299811a2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788510279.076022:0:6667:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788510279.076025:0:6667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788510279.076134:0:6667:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788510279.076291:0:6667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788510279.076316:0:6667:0:(import.c:65:import_set_state_nolock()) ffff9299811a4800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788510279.076665:0:6722:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788510279.076743:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788510279.076749:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510279.076752:0:6722:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788510279.076755:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788510279.076759:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510279.076760:0:6722:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788510279.076763:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788510279.076765:0:6722:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788510279.076791:0:6722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6722:1875388860999936:0@lo:502: 00000100:00100000:0.0:1788510279.076855:0:6722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510279.076884:0:6722:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510279.077005:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388860999936 00000100:00100000:3.0:1788510279.077010:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388860999936 00000100:00100000:3.0:1788510279.077042:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788510279.077051:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:6722:x1875388860999936:12345-0@lo:502: 00000100:00100000:3.0:1788510279.077286:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:6722:x1875388860999936:12345-0@lo:502: Request processed in 235us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510279.077294:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788510279.077334:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788510279.077343:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861000064:0@lo:400: 00000100:00100000:3.0:1788510279.077372:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510279.077403:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861000192:0@lo:400: 00000100:00100000:3.0:1788510279.077428:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510279.077668:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861000064 00000100:00100000:3.0:1788510279.077673:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861000064 00000100:00100000:3.0:1788510279.077701:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861000192 00000100:00100000:3.0:1788510279.077704:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861000192 00000100:00100000:3.0:1788510279.077727:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788510279.077734:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861000064:12345-0@lo:400: 00000100:00100000:3.0:1788510279.077773:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861000064:12345-0@lo:400: Request processed in 39us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510279.077779:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788510279.077791:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788510279.077798:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861000192:12345-0@lo:400: 00000100:00100000:3.0:1788510279.077838:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861000192:12345-0@lo:400: Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510279.077856:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788510279.077878:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788510279.077903:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab50ec000 x1875388861000192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510279.077918:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861000192:0@lo:400: 00010000:00080000:3.0:1788510279.077945:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab50ec380 x1875388861000064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510279.077953:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861000064:0@lo:400: 00000100:00100000:3.0:1788510279.077980:0:6722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:6722:1875388860999936:0@lo:502: 00000020:01000000:3.0:1788510279.078004:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788510279.078009:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510279.078011:0:6722:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788510279.078016:0:6722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788510279.078066:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788510279.078083:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788510279.078093:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.078103:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510279.078114:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788510279.078116:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff929a84fbcd40 from 1 10000000:01000000:3.0:1788510279.078119:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788510279.078145:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.078163:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.078172:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510279.078185:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861000320:0@lo:101: 00000100:00100000:3.0:1788510279.078211:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510279.078249:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff92998183fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788510279.078265:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861000320 00000100:00100000:3.0:1788510279.078269:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861000320 00000100:00100000:3.0:1788510279.078291:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788510279.078298:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861000320:12345-0@lo:101: 00010000:00010000:3.0:1788510279.078306:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510279.078318:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81533800/0x3e734462ed65241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6523a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.078338:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81533800/0x3e734462ed65241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6523a expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.078348:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81533800/0x3e734462ed65241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6523a expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.078356:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81533800, rc 0) 00000100:00100000:3.0:1788510279.078381:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861000320:12345-0@lo:101: Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510279.078386:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788510279.078409:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861000320:0@lo:101: 00010000:00010000:3.0:1788510279.078424:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.078433:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510279.079044:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861000448:0@lo:501: 00000100:00100000:3.0:1788510279.079076:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510279.079096:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff92998183fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788510279.079115:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861000448 00000100:00100000:3.0:1788510279.079118:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861000448 00000100:00100000:3.0:1788510279.079141:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788510279.079149:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861000448:12345-0@lo:501: 00000100:00100000:3.0:1788510279.079385:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861000448:12345-0@lo:501: Request processed in 237us (308us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788510279.079392:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788510279.079429:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861000448:0@lo:501: 10000000:01000000:3.0:1788510279.079652:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788510279.079659:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510279.079668:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510279.079875:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1875388860999808:12345-0@lo:8: Request processed in 3934us (4101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510279.079884:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788510279.086800:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929abaf22680 x1875388860999808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788510289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510279.086816:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788510279.086827:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788510279.086847:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788510279.086854:0:3287:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788510279.086857:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a85c6e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788510279.087587:0:3287:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788510279.087599:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388860999808:0@lo:8: 00000004:00080000:0.0:1788510279.090989:0:6724:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788510279.091126:0:6724:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 136909902542ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788510279.199758:0:6725:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788510279.199790:0:6725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6725:1875388861000704:0@lo:7: 00000100:00100000:1.0:1788510279.199868:0:6725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510279.199917:0:6725:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a857c3c00 going to sleep for 11 seconds 00000004:00080000:1.0:1788510279.199933:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788510279.199971:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861000576:0@lo:13: 00000100:00100000:1.0:1788510279.199998:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510279.200039:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861000704 00000100:00100000:1.0:1788510279.200045:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861000704 00000100:00100000:1.0:1788510279.200093:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510279.200111:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6725:x1875388861000704:12345-0@lo:7: 00000100:00080000:0.0:1788510279.205337:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510279.205367:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861000576 00000100:00100000:0.0:1788510279.205377:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861000576 00000100:00100000:0.0:1788510279.205436:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510279.205445:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861000576:12345-0@lo:13: 00002000:00000024:0.0:1788510279.205475:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788510279.205557:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861000576:12345-0@lo:13: Request processed in 113us (5558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510279.205564:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788510279.205621:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab4e98000 x1875388861000576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510279.205642:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861000576:0@lo:13: 00002000:00080000:1.0:1788510279.214322:0:6670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788510279.214330:0:6670:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788510279.214428:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6725:x1875388861000704:12345-0@lo:7: Request processed in 14315us (14555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510279.214440:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788510279.218326:0:6725:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab4e99500 x1875388861000704/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788510295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510279.218345:0:6725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6725:1875388861000704:0@lo:7: 00000004:00080000:0.0:1788510279.218361:0:6725:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788510279.218412:0:6725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6725:1875388861000832:0@lo:5: 00000100:00100000:0.0:1788510279.218470:0:6725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510279.218519:0:6725:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8560bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510279.218611:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861000832 00000100:00100000:1.0:1788510279.218619:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861000832 00000100:00100000:1.0:1788510279.218681:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788510279.218692:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6725:x1875388861000832:12345-0@lo:5: 00002000:00080000:1.0:1788510279.218719:0:6667:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788510279.218723:0:6667:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788510279.219057:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6725:x1875388861000832:12345-0@lo:5: Request processed in 367us (586us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788510279.219064:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788510279.219187:0:6725:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929abaf22680 x1875388861000832/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788510295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510279.219199:0:6725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6725:1875388861000832:0@lo:5: 00000004:00080000:0.0:1788510279.219206:0:6725:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788510279.219259:0:6725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6725:1875388861000960:0@lo:700: 00000100:00100000:0.0:1788510279.219285:0:6725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510279.219302:0:6725:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8560bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510279.219818:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861000960 00000100:00100000:1.0:1788510279.219824:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861000960 00000100:00100000:1.0:1788510279.219883:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788510279.219891:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6725:x1875388861000960:12345-0@lo:700: 00000100:00100000:1.0:1788510279.220059:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6676:1875388861001088:0@lo:700: 00000100:00100000:1.0:1788510279.220097:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510279.220122:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a857c3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788510279.220174:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861001088 00000100:00100000:0.0:1788510279.220179:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861001088 00000100:00100000:0.0:1788510279.220214:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510279.220240:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6676:x1875388861001088:12345-0@lo:700: 40000000:02000000:0.0:1788510279.361434:0:5828:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788510279.383630:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6676:x1875388861001088:12345-0@lo:700: Request processed in 163400us (163522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510279.383652:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788510279.384563:0:6676:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab4e9a680 x1875388861001088/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788510295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510279.384595:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6676:1875388861001088:0@lo:700: 40000000:02000000:0.0:1788510279.384608:0:6676:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788510279.519105:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788510279.519125:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788510279.519335:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6725:x1875388861000960:12345-0@lo:700: Request processed in 299439us (300042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510279.519353:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788510279.519692:0:6725:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929abaf20a80 x1875388861000960/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788510295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510279.519719:0:6725:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788510279.519737:0:6725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6725:1875388861000960:0@lo:700: 00000004:02000040:1.0:1788510279.671766:0:6725:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788510279.683600:0:6725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6725:1875388861001216:0@lo:5: 00000100:00100000:1.0:1788510279.683940:0:6725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510279.684085:0:6725:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c90240 going to sleep for 11 seconds 00000100:00100000:2.0:1788510279.684253:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861001216 00000100:00100000:2.0:1788510279.684262:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861001216 00000100:00100000:2.0:1788510279.684311:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788510279.684319:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6725:x1875388861001216:12345-0@lo:5: 00002000:00080000:2.0:1788510279.700798:0:6670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788510279.700833:0:6670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788510279.705832:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6725:x1875388861001216:12345-0@lo:5: Request processed in 21496us (21875us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788510279.705858:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788510279.705897:0:6725:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab4e9b480 x1875388861001216/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788510295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510279.705928:0:6725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6725:1875388861001216:0@lo:5: 00000004:00080000:1.0:1788510279.705944:0:6725:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788510279.954465:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510280.964570:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510281.988786:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510283.013601:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510284.042253:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510284.484881:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861001344:0@lo:400: 00000100:00100000:3.0:1788510284.484980:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510284.485046:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788510284.485053:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861001472:0@lo:400: 00000100:00100000:3.0:1788510284.485082:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510284.485110:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861001600:0@lo:400: 00000100:00100000:3.0:1788510284.485135:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510284.485155:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788510284.485160:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861001728:0@lo:400: 00000100:00100000:3.0:1788510284.485189:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510284.485216:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861001344 00000100:00100000:3.0:1788510284.485240:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861001344 00000100:00100000:3.0:1788510284.485286:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788510284.485295:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3288:x1875388861001344:12345-0@lo:400: 00000100:00100000:3.0:1788510284.485345:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3288:x1875388861001344:12345-0@lo:400: Request processed in 50us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510284.485351:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788510284.485382:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861001472 00000100:00100000:3.0:1788510284.485386:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861001472 00000100:00100000:3.0:1788510284.485407:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861001600 00000100:00100000:3.0:1788510284.485409:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861001600 00000100:00100000:3.0:1788510284.485431:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788510284.485436:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861001472:12345-0@lo:400: 00000100:00100000:3.0:1788510284.485466:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861001472:12345-0@lo:400: Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510284.485472:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788510284.485483:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788510284.485488:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861001600:12345-0@lo:400: 00000100:00100000:3.0:1788510284.485527:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861001600:12345-0@lo:400: Request processed in 39us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510284.485534:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788510284.485576:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab50eca80 x1875388861001600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510284.485605:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861001600:0@lo:400: 00010000:00080000:3.0:1788510284.485634:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab50ec000 x1875388861001472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510284.485643:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861001472:0@lo:400: 00000100:00100000:3.0:1788510284.485661:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861001344:0@lo:400: 00000100:00100000:0.0:1788510284.486186:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861001728 00000100:00100000:0.0:1788510284.486192:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861001728 00000100:00100000:0.0:1788510284.486242:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510284.486251:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861001728:12345-0@lo:400: 00000100:00100000:0.0:1788510284.486301:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861001728:12345-0@lo:400: Request processed in 52us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510284.486308:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788510284.486324:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788510284.486328:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788510284.486636:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab50ee680 x1875388861001728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510284.486647:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861001728:0@lo:400: 00000100:00100000:3.0:1788510284.488163:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788510284.488185:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861001856:0@lo:13: 00000100:00100000:3.0:1788510284.488266:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510284.488316:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861001856 00000100:00100000:3.0:1788510284.488323:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861001856 00000100:00100000:3.0:1788510284.488368:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788510284.488377:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875388861001856:12345-0@lo:13: 00002000:00000024:3.0:1788510284.488409:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510284.488452:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875388861001856:12345-0@lo:13: Request processed in 77us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510284.488460:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788510284.488498:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab50ec380 x1875388861001856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510284.488516:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861001856:0@lo:13: 00000001:00080000:1.0:1788510284.628709:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788510285.061281:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788510285.532186:0:7036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788510286.087438:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510287.109718:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510288.134445:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510289.156569:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510289.604697:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861001984:0@lo:13: 00000100:00100000:3.0:1788510289.604776:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510289.604866:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861001984 00000100:00100000:3.0:1788510289.604875:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861001984 00000100:00100000:3.0:1788510289.604937:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788510289.604948:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861001984:12345-0@lo:13: 00002000:00000024:3.0:1788510289.604981:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510289.605026:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861001984:12345-0@lo:13: Request processed in 80us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510289.605034:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788510289.605055:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788510289.605084:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab50ec380 x1875388861001984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510289.605097:0:3289:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788510289.605119:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861001984:0@lo:13: 00000100:00100000:0.0:1788510289.606909:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861002240:0@lo:400: 00000100:00100000:0.0:1788510289.606980:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510289.607019:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788510289.607024:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861002112:0@lo:400: 00000100:00100000:0.0:1788510289.607057:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510289.607187:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861002240 00000100:00100000:3.0:1788510289.607196:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861002240 00000100:00100000:3.0:1788510289.607261:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788510289.607270:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861002240:12345-0@lo:400: 00000100:00100000:3.0:1788510289.607660:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861002240:12345-0@lo:400: Request processed in 390us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510289.607676:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788510289.607714:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861002112 00000100:00100000:3.0:1788510289.607718:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861002112 00000100:00100000:3.0:1788510289.607747:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788510289.607753:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3291:x1875388861002112:12345-0@lo:400: 00000100:00100000:3.0:1788510289.607797:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3291:x1875388861002112:12345-0@lo:400: Request processed in 44us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510289.607804:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788510289.607839:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861002368:0@lo:400: 00000100:00100000:3.0:1788510289.607863:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510289.607893:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861002368 00000100:00100000:3.0:1788510289.607896:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861002368 00000100:00100000:3.0:1788510289.607926:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788510289.607933:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861002368:12345-0@lo:400: 00000100:00100000:3.0:1788510289.607966:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861002368:12345-0@lo:400: Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510289.607971:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788510289.607987:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788510289.608013:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929abaf20380 x1875388861002368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510289.608027:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861002368:0@lo:400: 00000100:00100000:3.0:1788510289.608204:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861002112:0@lo:400: 00010000:00080000:3.0:1788510289.608215:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929abaf21500 x1875388861002240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510289.608245:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861002240:0@lo:400: 00010000:00010000:3.0:1788510290.182727:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510291.204572:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510292.228939:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510293.253927:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510294.276907:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510294.724537:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861002624:0@lo:400: 00000100:00100000:0.0:1788510294.724630:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510294.724714:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788510294.724721:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861002752:0@lo:400: 00000100:00100000:0.0:1788510294.724745:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510294.759446:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861002624 00000100:00100000:1.0:1788510294.759458:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861002624 00000100:00100000:0.0:1788510294.760331:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861002880:0@lo:400: 00000100:00100000:0.0:1788510294.760402:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510294.760460:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788510294.760468:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861002496:0@lo:400: 00000100:00100000:0.0:1788510294.760499:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510294.760522:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861003008:0@lo:13: 00000100:00100000:0.0:1788510294.760544:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510294.760589:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861002752 00000100:00100000:0.0:1788510294.760594:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861002752 00000100:00100000:0.0:1788510294.760646:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788510294.760655:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861002752:12345-0@lo:400: 00000100:00100000:0.0:1788510294.760705:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861002752:12345-0@lo:400: Request processed in 52us (35959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510294.760712:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788510294.760754:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929abaf21c00 x1875388861002752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510294.760768:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861002752:0@lo:400: 00000100:00100000:1.0:1788510294.761989:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788510294.762002:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861002624:12345-0@lo:400: 00000100:00100000:1.0:1788510294.762070:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861002624:12345-0@lo:400: Request processed in 72us (37441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510294.762078:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788510294.762139:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929abaf23100 x1875388861002624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510294.762158:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861002624:0@lo:400: 00000100:00100000:2.0:1788510294.763724:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861002880 00000100:00100000:2.0:1788510294.763737:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861002880 00000100:00100000:2.0:1788510294.763792:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788510294.763802:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861002880:12345-0@lo:400: 00000100:00100000:2.0:1788510294.763881:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861002880:12345-0@lo:400: Request processed in 80us (3478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510294.763888:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788510294.765037:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861002496 00000100:00100000:3.0:1788510294.765044:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861002496 00000100:00100000:3.0:1788510294.765074:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788510294.765081:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3288:x1875388861002496:12345-0@lo:400: 00000100:00100000:3.0:1788510294.765138:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3288:x1875388861002496:12345-0@lo:400: Request processed in 58us (4639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510294.765145:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788510294.765176:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861003008 00000100:00100000:3.0:1788510294.765180:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861003008 00000100:00100000:3.0:1788510294.765203:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788510294.765209:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861003008:12345-0@lo:13: 00002000:00000024:3.0:1788510294.765260:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510294.765295:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861003008:12345-0@lo:13: Request processed in 85us (4749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510294.765300:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788510294.765316:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788510294.765322:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510294.770721:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861002496:0@lo:400: 00010000:00080000:0.0:1788510294.770745:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab4e9b480 x1875388861003008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510294.770768:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861003008:0@lo:13: 00010000:00080000:0.0:1788510294.770782:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929abaf20e00 x1875388861002880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510294.770802:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861002880:0@lo:400: 00010000:00010000:2.0:1788510295.300431:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510296.324489:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510297.349414:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510298.373003:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788510298.770251:0:7603:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788510298.770256:0:7603:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788510298.770401:0:7603:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff929a85c6b800 00000020:01000004:3.0:1788510298.770418:0:7603:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788510298.770431:0:7603:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788510298.770444:0:7603:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff929ab4e819c0) 00000020:00000080:3.0:1788510298.770460:0:7603:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788510298.790752:0:7603:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788510298.791630:0:7603:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788510298.817484:0:7603:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788510298.821955:0:7603:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788510298.821991:0:7603:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788510298.822060:0:7603:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788510298.822092:0:7603:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788510298.822571:0:7603:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788510298.822589:0:7603:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788510298.822598:0:7603:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e734462ed6524f 00000020:01000004:3.0:1788510298.822605:0:7603:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788510298.822625:0:7603:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788510298.822628:0:7603:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788510298.822633:0:7603:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788510298.822653:0:7603:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788510298.822657:0:7603:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788510298.837644:0:7603:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788510298.837688:0:7603:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.104@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788510298.837693:0:7603:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788510298.837694:0:7603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788510298.837695:0:7603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510298.837696:0:7603:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510298.837697:0:7603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510298.837698:0:7603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510298.837699:0:7603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788510298.837701:0:7603:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788510298.837702:0:7603:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788510298.837704:0:7603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510298.837705:0:7603:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788510298.837709:0:7603:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788510298.837712:0:7603:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788510298.837713:0:7603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788510298.837714:0:7603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510298.837715:0:7603:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510298.837716:0:7603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510298.837717:0:7603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510298.837718:0:7603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788510298.837719:0:7603:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788510298.837719:0:7603:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788510298.837720:0:7603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510298.837721:0:7603:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788510298.837749:0:7603:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788510298.837769:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861003136:0@lo:253: 00000100:00100000:3.0:1788510298.837841:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510298.837954:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cc76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510298.838034:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861003136 00000100:00100000:0.0:1788510298.838042:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861003136 00000100:00100000:0.0:1788510298.838182:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788510298.838193:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+16:7603:x1875388861003136:12345-0@lo:253: 20000000:01000000:0.0:1788510298.838241:0:5816:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788510298.838246:0:5816:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788510298.838251:0:5816:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788510298.838255:0:5816:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788510298.839405:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788510298.839599:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788510298.839613:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788510298.839646:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788510298.839653:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788510298.839677:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788510298.839715:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788510298.840043:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788510298.840060:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.104@tcp 20000000:01000000:0.0:1788510298.840062:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788510298.840090:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788510298.840096:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788510298.840400:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788510298.840409:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.104@tcp (null) (null) 00000040:00080000:0.0:1788510298.840451:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788510298.840461:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788510298.840486:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788510298.840545:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788510298.841383:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788510298.841401:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.104@tcp 20000000:01000000:0.0:1788510298.841408:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788510298.841444:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788510298.841451:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788510298.841476:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788510298.841482:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.104@tcp (null) (null) 00000040:00080000:0.0:1788510298.841521:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788510298.841529:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788510298.841566:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788510298.841595:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788510298.841609:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788510298.841613:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788510298.841617:0:5816:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788510298.841628:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788510298.841631:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788510298.841660:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788510298.841662:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788510298.842401:0:7605:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788510298.842462:0:7605:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788510298.842783:0:7605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788510298.843520:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788510298.843571:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788510298.843635:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788510298.843649:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788510298.843652:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788510298.844381:0:7606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788510298.845298:0:7606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788510298.845377:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788510298.845710:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788510298.845751:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788510298.845970:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788510298.846069:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788510298.846072:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788510298.847084:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788510298.847580:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788510298.847652:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788510298.847720:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788510298.847735:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788510298.847737:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788510298.849426:0:7608:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788510298.849528:0:7608:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788510298.849590:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788510298.849987:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788510298.850033:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788510298.850085:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788510298.850101:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788510298.850169:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788510298.850180:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788510298.850199:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850218:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a81679200/0x3e734462ed651a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed651a0 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850384:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a80030800/0x3e734462ed651d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed651ca expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850392:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a81533200/0x3e734462ed651fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed651f4 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850398:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a81533a00/0x3e734462ed65217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65210 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850405:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a81533800/0x3e734462ed65241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6523a expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850412:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850456:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a81533800/0x3e734462ed65241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6523a expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850471:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a81533800/0x3e734462ed65241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6523a expref: 16 pid: 5814 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510298.850485:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1875388861003264:0@lo:104: 00000100:00100000:0.0:1788510298.850575:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788510298.850666:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a81533a00/0x3e734462ed65217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed65210 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850675:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a81533a00/0x3e734462ed65217 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed65210 expref: 16 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510298.850684:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1875388861003392:0@lo:104: 00010000:00010000:0.0:1788510298.850712:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a81533200/0x3e734462ed651fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed651f4 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850720:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a81533200/0x3e734462ed651fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed651f4 expref: 16 pid: 5814 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510298.850728:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf21c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1875388861003520:0@lo:104: 00010000:00010000:0.0:1788510298.850749:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a80030800/0x3e734462ed651d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed651ca expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850756:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a80030800/0x3e734462ed651d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed651ca expref: 16 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510298.850763:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1875388861003648:0@lo:104: 00010000:00010000:0.0:1788510298.850785:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a81679200/0x3e734462ed651a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed651a0 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.850799:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a81679200/0x3e734462ed651a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed651a0 expref: 16 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510298.850808:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1875388861003776:0@lo:104: 00000100:00100000:0.0:1788510298.850826:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4c84cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510298.851622:0:5805:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788510298.851650:0:5805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510298.851709:0:5805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510298.851752:0:5805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510298.851768:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861003264 00000100:00100000:0.0:1788510298.851774:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861003264 00000100:00100000:0.0:1788510298.851821:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861003392 00000100:00100000:0.0:1788510298.851824:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861003392 00000100:00100000:0.0:1788510298.851834:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861003520 00000100:00100000:0.0:1788510298.851836:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861003520 00000100:00100000:0.0:1788510298.851851:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788510298.851860:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a86181850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+5:5816:x1875388861003264:12345-0@lo:104: 00010000:00010000:0.0:1788510298.851875:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510298.852008:0:5805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510298.852018:0:5805:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788510298.852023:0:5805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788510298.852202:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788510298.852210:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a86181850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+5:5816:x1875388861003264:12345-0@lo:104: Request processed in 351us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510298.852217:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788510298.852267:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861003648 00000100:00100000:0.0:1788510298.852271:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861003648 00000100:00100000:0.0:1788510298.852282:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861003776 00000100:00100000:0.0:1788510298.852284:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861003776 00000100:00100000:0.0:1788510298.852293:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788510298.852297:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+6:5816:x1875388861003392:12345-0@lo:104: 00010000:00010000:0.0:1788510298.852305:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510298.852474:0:7609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788510298.852483:0:7609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+6:5816:x1875388861003520:12345-0@lo:104: 00010000:00010000:2.0:1788510298.852501:0:7609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510298.852597:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1875388861003264:0@lo:104: 00000100:00100000:3.0:1788510298.852606:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1875388861003392:0@lo:104: 00000100:00100000:3.0:1788510298.852613:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf21c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1875388861003520:0@lo:104: 00010000:00010000:1.0:1788510298.852666:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788510298.852673:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852679:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81532c00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510298.852683:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852690:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510298.852696:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510298.852702:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788510298.852740:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852746:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510298.852763:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852769:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81532c00/0x3e734462ed6523a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65241 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852803:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788510298.852806:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852811:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80030400 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510298.852813:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852819:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510298.852825:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510298.852829:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788510298.852842:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852847:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510298.852852:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852857:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a80030400/0x3e734462ed65210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65217 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852866:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510298.852868:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852882:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81679e00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510298.852886:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852891:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510298.852897:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510298.852901:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788510298.852913:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852917:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510298.852933:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852939:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81679e00/0x3e734462ed651f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.852949:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510298.852950:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510298.852952:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510298.852977:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861003904:0@lo:103: 00000100:00100000:1.0:1788510298.853012:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510298.853052:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788510298.853057:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861004032:0@lo:103: 00000100:00100000:1.0:1788510298.853086:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510298.853249:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861004160:0@lo:103: 00000100:00100000:1.0:1788510298.853274:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510298.853310:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861003904 00000100:00100000:1.0:1788510298.853316:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861003904 00010000:00010000:1.0:1788510298.853335:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a81533800/0x3e734462ed65241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6523a expref: 17 pid: 5814 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510298.853351:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861004032 00000100:00100000:1.0:1788510298.853354:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861004032 00010000:00010000:1.0:1788510298.853365:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a81533a00/0x3e734462ed65217 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65210 expref: 18 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510298.853374:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861004160 00000100:00100000:1.0:1788510298.853376:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861004160 00010000:00010000:1.0:1788510298.853385:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a81533200/0x3e734462ed651fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed651f4 expref: 19 pid: 5814 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510298.853395:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788510298.853401:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861003904:12345-0@lo:103: 00010000:00010000:1.0:1788510298.853411:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510298.853416:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a81533800/0x3e734462ed65241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6523a expref: 19 pid: 5814 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.853426:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a81533800/0x3e734462ed65241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6523a expref: 19 pid: 5814 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.853442:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81533800/0x3e734462ed65241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6523a expref: 19 pid: 5814 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.853457:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510298.853506:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:3290:x1875388861003904:12345-0@lo:103: Request processed in 104us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.853513:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788510298.853530:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788510298.853536:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:3290:x1875388861004032:12345-0@lo:103: 00010000:00010000:1.0:1788510298.853544:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510298.853548:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a81533a00/0x3e734462ed65217 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65210 expref: 17 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.853558:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a81533a00/0x3e734462ed65217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed65210 expref: 17 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.853568:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81533a00/0x3e734462ed65217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed65210 expref: 17 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.853577:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510298.853595:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3290:x1875388861004032:12345-0@lo:103: Request processed in 60us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.853601:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788510298.853611:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788510298.853616:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+15:3288:x1875388861004160:12345-0@lo:103: 00010000:00010000:1.0:1788510298.853622:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510298.853626:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a81533200/0x3e734462ed651fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed651f4 expref: 15 pid: 5814 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.853634:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a81533200/0x3e734462ed651fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed651f4 expref: 15 pid: 5814 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.853643:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81533200/0x3e734462ed651fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed651f4 expref: 15 pid: 5814 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.853655:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510298.853676:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+14:3288:x1875388861004160:12345-0@lo:103: Request processed in 60us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.853682:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788510298.853711:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861004160:0@lo:103: 00000100:00100000:1.0:1788510298.853729:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861004032:0@lo:103: 00000100:00100000:1.0:1788510298.853735:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861003904:0@lo:103: 00010000:00010000:0.0:1788510298.854028:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788510298.854038:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+6:5816:x1875388861003392:12345-0@lo:104: Request processed in 1738us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510298.854046:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788510298.854064:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788510298.854072:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+5:5816:x1875388861003648:12345-0@lo:104: 00010000:00010000:0.0:1788510298.854089:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.854146:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788510298.854152:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+5:5816:x1875388861003648:12345-0@lo:104: Request processed in 82us (2399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510298.854158:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788510298.854171:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788510298.854176:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+4:5816:x1875388861003776:12345-0@lo:104: 00010000:00010000:0.0:1788510298.854184:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.854213:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788510298.854217:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+4:5816:x1875388861003776:12345-0@lo:104: Request processed in 42us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510298.854244:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788510298.854375:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788510298.854380:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854387:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81678a00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510298.854390:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854398:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510298.854405:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510298.854411:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788510298.854438:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854444:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510298.854457:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854469:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81678a00/0x3e734462ed651ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651d1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854483:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510298.854497:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854503:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81678400 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510298.854506:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854513:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510298.854519:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510298.854525:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788510298.854539:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854545:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510298.854556:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854563:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81678400/0x3e734462ed651a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651a7 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854577:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510298.854583:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510298.854585:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510298.854598:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861004288:0@lo:103: 00000100:00100000:1.0:1788510298.854625:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510298.854654:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510298.854660:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861004416:0@lo:103: 00000100:00100000:1.0:1788510298.854678:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510298.854697:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861004288 00000100:00100000:1.0:1788510298.854701:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861004288 00010000:00010000:1.0:1788510298.854716:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a80030800/0x3e734462ed651d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed651ca expref: 14 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510298.854732:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861004416 00000100:00100000:1.0:1788510298.854735:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861004416 00010000:00010000:1.0:1788510298.854742:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a81679200/0x3e734462ed651a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed651a0 expref: 15 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510298.854753:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788510298.854757:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:3289:x1875388861004288:12345-0@lo:103: 00010000:00010000:1.0:1788510298.854764:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510298.854769:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a80030800/0x3e734462ed651d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed651ca expref: 15 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854778:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a80030800/0x3e734462ed651d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed651ca expref: 15 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854789:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510298.854813:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:3289:x1875388861004288:12345-0@lo:103: Request processed in 55us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.854818:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788510298.854840:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788510298.854846:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:3291:x1875388861004416:12345-0@lo:103: 00010000:00010000:1.0:1788510298.854853:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510298.854858:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a81679200/0x3e734462ed651a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed651a0 expref: 14 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854866:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a81679200/0x3e734462ed651a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed651a0 expref: 14 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854879:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854888:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854902:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854909:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854915:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854920:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854925:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80031a00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510298.854929:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854936:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854951:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.854962:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510298.854988:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:3291:x1875388861004416:12345-0@lo:103: Request processed in 142us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.854994:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788510298.855025:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861004416:0@lo:103: 00000100:00100000:1.0:1788510298.855047:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861004288:0@lo:103: 00010000:00010000:1.0:1788510298.855061:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510298.855194:0:7609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788510298.855204:0:7609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+3:5816:x1875388861003520:12345-0@lo:104: Request processed in 2722us (3492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510298.855219:0:7609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788510298.855294:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510298.855448:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80030800/0x3e734462ed651d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed651ca expref: 13 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510298.855461:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1875388861003648:0@lo:104: 00010000:00010000:0.0:1788510298.855471:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81679200/0x3e734462ed651a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed651a0 expref: 12 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510298.855479:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1875388861003776:0@lo:104: 00010000:00010000:0.0:1788510298.855517:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.855527:0:5816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.855541:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.855547:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80031a00/0x3e734462ed65256 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788510298.855562:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788510298.900514:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+11:7603:x1875388861003136:12345-0@lo:253: Request processed in 62313us (62663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510298.900532:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788510298.900619:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861003136:0@lo:253: 10000000:01000000:3.0:1788510298.900637:0:7603:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788510298.900642:0:7603:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788510298.900643:0:7603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788510298.900645:0:7603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510298.900646:0:7603:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788510298.900647:0:7603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510298.900649:0:7603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510298.900650:0:7603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788510298.900652:0:7603:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788510298.900653:0:7603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510298.900654:0:7603:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788510298.900674:0:7603:0:(tgt_mount.c:101:server_register_mount()) register mount ffff929a85c6b800 from lustre-OST0001 10000000:01000000:3.0:1788510298.900699:0:7603:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788510298.900701:0:7603:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788510298.900709:0:7603:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff929a84fbcd40 local copy 10000000:01000000:3.0:1788510298.900713:0:7603:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788510298.900748:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510298.900759:0:7603:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510298.900783:0:7603:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510298.900802:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861004544:0@lo:101: 00000100:00100000:3.0:1788510298.900835:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510298.900903:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cc7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788510298.900936:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861004544 00000100:00100000:0.0:1788510298.900941:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861004544 00000100:00100000:0.0:1788510298.901009:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788510298.901018:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+11:7603:x1875388861004544:12345-0@lo:101: 00010000:00010000:0.0:1788510298.901030:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510298.901043:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a80031a00/0x3e734462ed65264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6525d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.901068:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80031a00/0x3e734462ed65264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6525d expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.901078:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a80031a00/0x3e734462ed65264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6525d expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.901087:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a80031a00, rc 0) 00000100:00100000:0.0:1788510298.901205:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861004544:12345-0@lo:101: Request processed in 187us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510298.901211:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788510298.901316:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861004544:0@lo:101: 00010000:00010000:2.0:1788510298.901328:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.901337:0:7603:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510298.901439:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861004672:0@lo:501: 00000100:00100000:2.0:1788510298.901464:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510298.901505:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788510298.901557:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861004672 00000100:00100000:1.0:1788510298.901562:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861004672 00000100:00100000:1.0:1788510298.901619:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788510298.901627:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861004672:12345-0@lo:501: 00000100:00100000:1.0:1788510298.901815:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861004672:12345-0@lo:501: Request processed in 189us (349us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788510298.901822:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788510298.901908:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861004672:0@lo:501: 10000000:01000000:2.0:1788510298.901920:0:7603:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788510298.901942:0:7603:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788510298.901947:0:7603:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.901955:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.901962:0:7603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.901981:0:7603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788510298.902003:0:7603:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff929a85c6b800 10000000:01000000:2.0:1788510298.902007:0:7603:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788510298.902012:0:7603:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788510298.902019:0:7603:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788510298.902023:0:7603:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788510298.902026:0:7603:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788510298.902041:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.902049:0:7603:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.902057:0:7603:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510298.902067:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861004800:0@lo:101: 00000100:00100000:2.0:1788510298.902088:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788510298.902180:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510298.902187:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.902194:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81533c00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510298.902198:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.902206:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510298.902219:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510298.902241:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788510298.902259:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.902265:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510298.902280:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.902287:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed6525d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e734462ed65264 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.902299:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510298.902301:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510298.902303:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510298.902312:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861004928:0@lo:103: 00000100:00100000:0.0:1788510298.902359:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861004800 00000100:00100000:0.0:1788510298.902362:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861004800 00000100:00100000:0.0:1788510298.902382:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788510298.902388:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861004800:12345-0@lo:101: 00010000:00010000:0.0:1788510298.902394:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510298.902403:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a80030800/0x3e734462ed65272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6526b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.902417:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80030800/0x3e734462ed65272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6526b expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.902425:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a80030800/0x3e734462ed65272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6526b expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510298.902432:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a80030800, rc 0) 00000100:00100000:1.0:1788510298.902549:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510298.902624:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861004928 00000100:00100000:3.0:1788510298.902628:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861004928 00000100:00100000:3.0:1788510298.902660:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788510298.902666:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:3291:x1875388861004928:12345-0@lo:103: 00010000:00010000:3.0:1788510298.902674:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510298.902684:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80031a00/0x3e734462ed65264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed6525d expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510298.902693:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510298.902716:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:3291:x1875388861004928:12345-0@lo:103: Request processed in 51us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510298.902722:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510298.902771:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861004928:0@lo:103: 00000100:00100000:0.0:1788510298.902823:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861004800:12345-0@lo:101: Request processed in 434us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510298.902829:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788510298.902873:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788510298.902883:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861004800:0@lo:101: 00010000:00010000:2.0:1788510298.902893:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.902901:0:7603:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510298.902956:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005056:0@lo:501: 00000100:00100000:2.0:1788510298.902976:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510298.903020:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788510298.903047:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861005056 00000100:00100000:3.0:1788510298.903051:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861005056 00000100:00100000:3.0:1788510298.903100:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788510298.903167:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861005056:12345-0@lo:501: 00000100:00100000:2.0:1788510298.903621:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861005056:12345-0@lo:501: Request processed in 454us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510298.903628:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788510298.903675:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005056:0@lo:501: 00000100:00100000:3.0:1788510298.903703:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005184:0@lo:503: 00000100:00100000:3.0:1788510298.903742:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510298.903807:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cc7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788510298.903845:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861005184 00000100:00100000:0.0:1788510298.903849:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861005184 00000100:00100000:0.0:1788510298.903917:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788510298.903925:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861005184:12345-0@lo:503: 00000100:00100000:0.0:1788510298.904075:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861005184:12345-0@lo:503: Request processed in 150us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510298.904083:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788510298.904154:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005184:0@lo:503: 00000040:00080000:3.0:1788510298.904468:0:7603:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788510298.904538:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005312:0@lo:502: 00000100:00100000:3.0:1788510298.904573:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510298.904882:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cc7540 going to sleep for 11 seconds 00000100:00100000:1.0:1788510298.904988:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861005312 00000100:00100000:1.0:1788510298.904993:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861005312 00000100:00100000:1.0:1788510298.905020:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788510298.905027:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861005312:12345-0@lo:502: 00000100:00100000:1.0:1788510298.905202:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861005312:12345-0@lo:502: Request processed in 176us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.905210:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788510298.905371:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005312:0@lo:502: 00000040:00080000:3.0:1788510298.905650:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788510298.905706:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788510298.905739:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788510298.905782:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788510298.905817:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788510298.905852:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788510298.905883:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005440:0@lo:502: 00000100:00100000:3.0:1788510298.905926:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510298.905968:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cc7540 going to sleep for 11 seconds 00000100:00100000:1.0:1788510298.906021:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861005440 00000100:00100000:1.0:1788510298.906025:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861005440 00000100:00100000:1.0:1788510298.906049:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788510298.906057:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861005440:12345-0@lo:502: 00000100:00100000:1.0:1788510298.906314:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861005440:12345-0@lo:502: Request processed in 258us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.906326:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788510298.906412:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005440:0@lo:502: 00000040:00080000:3.0:1788510298.906499:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788510298.906510:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788510298.906958:0:7611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788510298.906971:0:7611:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788510298.906978:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510298.906980:0:7611:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788510298.906986:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788510298.907001:0:7611:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff929ab4e80000) 00000020:00000080:3.0:1788510298.907024:0:7611:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788510298.907030:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788510298.907174:0:7611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff929a85c6b800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788510298.907184:0:7611:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788510298.907192:0:7611:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e734462ed65280 00010000:00010000:3.0:1788510298.911055:0:7611:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788510298.911649:0:7611:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788510298.914951:0:7611:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788510298.915692:0:7611:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788510298.922574:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788510298.923008:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788510298.925792:0:7611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788510298.925805:0:7611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510298.925812:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510298.925814:0:7611:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788510298.925817:0:7611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510298.925820:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510298.925822:0:7611:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788510298.925824:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788510298.925826:0:7611:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788510298.925882:0:7611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510298.925885:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510298.925887:0:7611:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788510298.925889:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788510298.926894:0:7603:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788510298.926926:0:7603:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788510298.926945:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510298.926959:0:7603:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510298.926967:0:7603:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929a85c6b800 from 1 10000000:01000000:3.0:1788510298.926970:0:7603:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788510298.927004:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510298.927012:0:7603:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510298.927023:0:7603:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510298.927045:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005568:0@lo:101: 00000100:00100000:3.0:1788510298.927110:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510298.927143:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cc7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788510298.927805:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861005568 00000100:00100000:1.0:1788510298.927814:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861005568 00000100:00100000:1.0:1788510298.927863:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788510298.927874:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+12:7603:x1875388861005568:12345-0@lo:101: 00010000:00010000:1.0:1788510298.927891:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510298.927907:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a83033c00/0x3e734462ed6528e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65287 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.927934:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83033c00/0x3e734462ed6528e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65287 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.927954:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a83033c00/0x3e734462ed6528e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65287 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.927962:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033c00, rc 0) 00000100:00100000:1.0:1788510298.928021:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:7603:x1875388861005568:12345-0@lo:101: Request processed in 149us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.928028:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788510298.928091:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005568:0@lo:101: 00010000:00010000:3.0:1788510298.928172:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510298.928182:0:7603:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510298.928321:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005696:0@lo:501: 00000100:00100000:3.0:1788510298.928349:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510298.928379:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cc7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788510298.929997:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861005696 00000100:00100000:1.0:1788510298.930007:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861005696 00000100:00100000:1.0:1788510298.930060:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788510298.930069:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:7603:x1875388861005696:12345-0@lo:501: 00000100:00100000:1.0:1788510298.930378:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:7603:x1875388861005696:12345-0@lo:501: Request processed in 309us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.930385:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788510298.930725:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005696:0@lo:501: 00000100:00100000:0.0:1788510298.930775:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005824:0@lo:503: 00000100:00100000:0.0:1788510298.930826:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510298.930863:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4c84000 going to sleep for 11 seconds 00000100:00100000:1.0:1788510298.930911:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861005824 00000100:00100000:1.0:1788510298.930916:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861005824 00000100:00100000:1.0:1788510298.930952:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788510298.930960:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:7603:x1875388861005824:12345-0@lo:503: 00000100:00100000:1.0:1788510298.931277:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:7603:x1875388861005824:12345-0@lo:503: Request processed in 317us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.931284:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788510298.931378:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005824:0@lo:503: 00000040:00080000:0.0:1788510298.931702:0:7603:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788510298.931764:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005952:0@lo:502: 00000100:00100000:0.0:1788510298.931799:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510298.931828:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4c84000 going to sleep for 11 seconds 00000100:00100000:3.0:1788510298.931877:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861005952 00000100:00100000:3.0:1788510298.931882:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861005952 00000100:00100000:3.0:1788510298.931914:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788510298.931922:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:7603:x1875388861005952:12345-0@lo:502: 00000100:00100000:3.0:1788510298.932165:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:7603:x1875388861005952:12345-0@lo:502: Request processed in 243us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510298.932172:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788510298.932186:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861005952:0@lo:502: 00000040:00080000:0.0:1788510298.932697:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788510298.932752:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788510298.932778:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006080:0@lo:502: 00000100:00100000:0.0:1788510298.932815:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510298.932843:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4c84000 going to sleep for 11 seconds 00000100:00100000:2.0:1788510298.932955:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861006080 00000100:00100000:2.0:1788510298.932966:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861006080 00000100:00100000:2.0:1788510298.932994:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788510298.933001:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:7603:x1875388861006080:12345-0@lo:502: 00000100:00100000:2.0:1788510298.933146:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:7603:x1875388861006080:12345-0@lo:502: Request processed in 145us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510298.933154:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788510298.933251:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006080:0@lo:502: 00000040:00080000:1.0:1788510298.933339:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788510298.933350:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788510298.936833:0:7615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788510298.936846:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510298.936848:0:7615:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788510298.936854:0:7615:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff929a85c6b800 00000020:00000080:0.0:1788510298.936857:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788510298.936873:0:7615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788510298.936876:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510298.936877:0:7615:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788510298.936880:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788510298.937325:0:7603:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788510298.937350:0:7603:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788510298.937371:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.937383:0:7603:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510298.937430:0:7603:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788510298.937432:0:7603:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff929a85c6b800 10000000:01000000:2.0:1788510298.937435:0:7603:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff929a85c6b800 10000000:01000000:2.0:1788510298.937439:0:7603:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788510298.937443:0:7603:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff929a85c6b800 from 1 10000000:01000000:2.0:1788510298.937446:0:7603:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788510298.937479:0:7603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.937523:0:7603:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.937539:0:7603:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510298.937561:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006208:0@lo:101: 00000100:00100000:2.0:1788510298.937647:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510298.937678:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788510298.938080:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861006208 00000100:00100000:3.0:1788510298.938088:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861006208 00000100:00100000:3.0:1788510298.939286:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788510298.939300:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:7603:x1875388861006208:12345-0@lo:101: 00010000:00010000:3.0:1788510298.939317:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510298.939333:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81532a00/0x3e734462ed6529c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65295 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510298.939357:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81532a00/0x3e734462ed6529c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65295 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510298.939369:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81532a00/0x3e734462ed6529c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65295 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510298.939377:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81532a00, rc 0) 00000100:00100000:3.0:1788510298.939657:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+14:7603:x1875388861006208:12345-0@lo:101: Request processed in 359us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510298.939674:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788510298.941732:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006208:0@lo:101: 00010000:00010000:1.0:1788510298.941757:0:7603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.941781:0:7603:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510298.941899:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006336:0@lo:501: 00000100:00100000:1.0:1788510298.941951:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510298.942035:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aafe1ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788510298.942079:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861006336 00000100:00100000:0.0:1788510298.942086:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861006336 00000100:00100000:0.0:1788510298.942262:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788510298.942273:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:7603:x1875388861006336:12345-0@lo:501: 00000100:00100000:0.0:1788510298.942558:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:7603:x1875388861006336:12345-0@lo:501: Request processed in 287us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510298.942576:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788510298.942663:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006336:0@lo:501: 00000100:00100000:1.0:1788510298.942694:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006464:0@lo:503: 00000100:00100000:1.0:1788510298.942734:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510298.944335:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aafe1ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510298.944387:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861006464 00000100:00100000:3.0:1788510298.944395:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861006464 00000100:00100000:0.0:1788510298.944599:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788510298.944610:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:7603:x1875388861006464:12345-0@lo:503: 00000100:00100000:0.0:1788510298.944831:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:7603:x1875388861006464:12345-0@lo:503: Request processed in 223us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510298.944839:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788510298.944921:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006464:0@lo:503: 00000040:00080000:1.0:1788510298.945217:0:7603:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788510298.945342:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006592:0@lo:502: 00000100:00100000:1.0:1788510298.945382:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510298.945681:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85323300 going to sleep for 11 seconds 00000100:00100000:2.0:1788510298.945727:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861006592 00000100:00100000:2.0:1788510298.945733:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861006592 00000100:00100000:2.0:1788510298.945762:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788510298.945770:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:7603:x1875388861006592:12345-0@lo:502: 00000100:00100000:2.0:1788510298.945968:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:7603:x1875388861006592:12345-0@lo:502: Request processed in 198us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510298.945976:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788510298.946054:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006592:0@lo:502: 00000040:00080000:1.0:1788510298.946609:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788510298.946662:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788510298.946698:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788510298.946744:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788510298.946779:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788510298.946825:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788510298.946862:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788510298.946899:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788510298.946950:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788510298.946987:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788510298.947036:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788510298.947182:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788510298.947301:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788510298.947343:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788510298.947397:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788510298.947580:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788510298.947613:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788510298.947663:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788510298.947709:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788510298.947746:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788510298.947815:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788510298.947853:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788510298.947886:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788510298.947950:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788510298.947987:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788510298.948021:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788510298.948070:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788510298.948512:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788510298.948555:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788510298.948607:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788510298.948668:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788510298.948702:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788510298.948734:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788510298.948784:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788510298.948819:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788510298.948868:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788510298.948906:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788510298.948957:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006720:0@lo:502: 00000100:00100000:1.0:1788510298.949036:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510298.949191:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aafe1ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510298.950544:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861006720 00000100:00100000:2.0:1788510298.950555:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861006720 00000100:00100000:2.0:1788510298.950616:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788510298.950625:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:7603:x1875388861006720:12345-0@lo:502: 00000100:00100000:2.0:1788510298.950882:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:7603:x1875388861006720:12345-0@lo:502: Request processed in 258us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510298.950890:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788510298.951041:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006720:0@lo:502: 00000040:00080000:1.0:1788510298.951252:0:7603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788510298.951268:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788510298.951946:0:7616:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788510298.951963:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff929aafdcb380) 00000020:00000080:1.0:1788510298.951997:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788510298.952067:0:7616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff929a85c6b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788510298.952071:0:7616:0:(tgt_mount.c:187:server_put_mount()) put mount ffff929a85c6b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788510298.952073:0:7616:0:(obd_mount.c:710:lustre_put_lsi()) put ffff929a85c6b800 3 00010000:00080000:1.0:1788510298.952668:0:7616:0:(ldlm_lib.c:102:import_set_conn()) imp ffff929981ead000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.104@tcp at head 00010000:00010000:1.0:1788510298.955575:0:7616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788510298.955824:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788510298.955868:0:7616:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788510298.955883:0:7616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3e734462ed652aa 00000100:00080000:1.0:1788510298.955895:0:7616:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788510298.955901:0:7616:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff929981ead000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:1.0:1788510298.955942:0:7616:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929ab4e9a680 x1875388861006848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788510298.955969:0:7616:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788510298.956056:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1875388861006848:0@lo:38: 00000100:00100000:2.0:1788510298.956148:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788510298.958258:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788510298.958387:0:7603:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788510298.958424:0:7603:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788510298.958440:0:7603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.958452:0:7603:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788510298.958548:0:7603:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788510298.958554:0:7603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788510298.958555:0:7603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510298.958556:0:7603:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510298.958557:0:7603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510298.958559:0:7603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510298.958560:0:7603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788510298.958562:0:7603:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788510298.958563:0:7603:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788510298.958564:0:7603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510298.958565:0:7603:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788510298.958570:0:7603:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788510298.958572:0:7603:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788510298.958573:0:7603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788510298.958574:0:7603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510298.958575:0:7603:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510298.958576:0:7603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510298.958577:0:7603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510298.958578:0:7603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788510298.958578:0:7603:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788510298.958580:0:7603:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788510298.958581:0:7603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510298.958581:0:7603:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788510298.958614:0:7603:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788510298.958635:0:7603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89045880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006976:0@lo:253: 00000100:00100000:2.0:1788510298.958712:0:7603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510298.958756:0:7603:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2c240 going to sleep for 11 seconds 00000100:00080000:1.0:1788510298.958945:0:7617:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff929ab4e9b100 x1875388861007104/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510298.958954:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884b9900 going to sleep for 0 seconds 00000100:00100000:1.0:1788510298.959172:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861007232:0@lo:400: 00000100:00100000:1.0:1788510298.959219:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510298.959399:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861007360:0@lo:400: 00000100:00100000:2.0:1788510298.959442:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510298.963140:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861006848 00000100:00100000:2.0:1788510298.963160:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861006848 00000100:00100000:2.0:1788510298.963197:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861007232 00000100:00100000:2.0:1788510298.963201:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861007232 00000100:00100000:2.0:1788510298.963246:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861007360 00000100:00100000:2.0:1788510298.963249:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861007360 00000100:00100000:2.0:1788510298.963295:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788510298.963305:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861007232:12345-0@lo:400: 00000100:00080000:3.0:1788510298.964024:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510298.964903:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861007232:12345-0@lo:400: Request processed in 1592us (5676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510298.964917:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788510298.964954:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788510298.964967:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861007360:12345-0@lo:400: 00000100:00100000:2.0:1788510298.965029:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861007360:12345-0@lo:400: Request processed in 68us (5586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510298.965036:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788510298.965051:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788510298.965056:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3287:x1875388861006848:12345-0@lo:38: 00010000:00080000:2.0:1788510298.965081:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:2.0:1788510298.965249:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e734462ed652b1 00000004:00100000:2.0:1788510298.965273:0:5823:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788510298.965320:0:5823:0:(import.c:65:import_set_state_nolock()) ffff929a84f5b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788510298.965371:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875388861006848:12345-0@lo:38: Request processed in 313us (9224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510298.965379:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788510298.965845:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab4e9a680 x1875388861006848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788510308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510298.965858:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788510298.965866:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788510298.965873:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788510298.965879:0:3287:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788510298.965881:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929981ead000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788510298.965888:0:3287:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ddcc209c): req@ffff929ab4e9b100 x1875388861007104/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510298.965905:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1875388861006848:0@lo:38: 00010000:00080000:2.0:1788510298.965964:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929abaf21c00 x1875388861007360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510298.965975:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861007360:0@lo:400: 00000100:00100000:2.0:1788510298.966005:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861006976 00000100:00100000:2.0:1788510298.966011:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861006976 00000100:00100000:2.0:1788510298.966056:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788510298.966063:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:7603:x1875388861006976:12345-0@lo:253: 20000000:01000000:2.0:1788510298.966181:0:5815:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788510298.966200:0:5815:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788510298.966898:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861007488:0@lo:400: 00000100:00100000:3.0:1788510298.966960:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510298.967050:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861007488 00000100:00100000:2.0:1788510298.967057:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861007488 00000100:00080000:3.0:1788510298.967186:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510298.967254:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510298.967263:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861007488:12345-0@lo:400: 00000100:00100000:2.0:1788510298.967310:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861007488:12345-0@lo:400: Request processed in 48us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510298.967317:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788510298.967398:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929abaf22d80 x1875388861007488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510298.967421:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861007488:0@lo:400: 00010000:00080000:1.0:1788510298.967552:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929abaf20a80 x1875388861007232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510298.967563:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861007232:0@lo:400: 00000100:00100000:1.0:1788510298.967646:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510298.967685:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884b9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788510298.968198:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861007104 00000100:00100000:3.0:1788510298.968205:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861007104 00000100:00100000:3.0:1788510298.968287:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788510298.968295:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7617:x1875388861007104:12345-0@lo:901: 00000100:00100000:3.0:1788510298.968740:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7617:x1875388861007104:12345-0@lo:901: Request processed in 445us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510298.968748:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788510298.968826:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788510298.968968:0:7617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929ab4e9b100 x1875388861007104/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788510314 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510298.968979:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9b100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7617:1875388861007104:0@lo:901: 20000000:01000000:1.0:1788510298.991549:0:5815:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788510298.991576:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788510298.991628:0:5837:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788510298.991633:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788510298.991657:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.991676:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a813fd000/0x3e734462ed65209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65202 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.991685:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.991731:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a813fd000/0x3e734462ed65209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed65202 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.991748:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a813fd000/0x3e734462ed65209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed65202 expref: 14 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510298.991764:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1875388861007616:0@lo:104: 00000100:00100000:2.0:1788510298.991836:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510298.991885:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85306c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510298.992545:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861007616 00000100:00100000:1.0:1788510298.992556:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861007616 00000100:00100000:1.0:1788510298.992610:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788510298.992619:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+3:5837:x1875388861007616:12345-0@lo:104: 00010000:00010000:1.0:1788510298.992635:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.992697:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788510298.992703:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+3:5837:x1875388861007616:12345-0@lo:104: Request processed in 86us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.992709:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788510298.992730:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510298.992736:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.992743:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80030c00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510298.992746:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.992755:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510298.992761:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510298.992782:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788510298.992813:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.992820:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510298.992836:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.992843:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed65202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65209 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.992859:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510298.992860:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510298.992862:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510298.992879:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861007744:0@lo:103: 00000100:00100000:1.0:1788510298.992912:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510298.992952:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861007744 00000100:00100000:1.0:1788510298.992956:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861007744 00010000:00010000:1.0:1788510298.992972:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a813fd000/0x3e734462ed65209 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65202 expref: 15 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510298.992993:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788510298.992999:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87750850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+15:3291:x1875388861007744:12345-0@lo:103: 00010000:00010000:1.0:1788510298.993010:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510298.993015:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a813fd000/0x3e734462ed65209 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65202 expref: 15 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.993025:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a813fd000/0x3e734462ed65209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed65202 expref: 15 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.993047:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.993055:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788510298.993067:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003974431s 00010000:00010000:1.0:1788510298.993072:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.993079:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.993085:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.993091:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.993097:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fcc00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510298.993112:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.993119:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.993128:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510298.993137:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510298.993169:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87750850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+15:3291:x1875388861007744:12345-0@lo:103: Request processed in 170us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510298.993181:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788510298.993266:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861007744:0@lo:103: 00010000:00010000:2.0:1788510298.993475:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fd000/0x3e734462ed65209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed65202 expref: 14 pid: 5815 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510298.993509:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1875388861007616:0@lo:104: 00010000:00010000:2.0:1788510298.993523:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.993531:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.993537:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510298.993542:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fcc00/0x3e734462ed652b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510299.001952:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:7603:x1875388861006976:12345-0@lo:253: Request processed in 35877us (43228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510299.001969:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788510299.002051:0:7603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89045880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:040cea51-0882-49ef-ac64-3cc6497ba05a:7603:1875388861006976:0@lo:253: 10000000:01000000:2.0:1788510299.002069:0:7603:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788510299.002073:0:7603:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788510299.002075:0:7603:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788510299.002076:0:7603:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510299.002078:0:7603:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510299.002079:0:7603:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510299.002080:0:7603:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510299.002082:0:7603:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788510299.002083:0:7603:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788510299.002084:0:7603:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788510299.002087:0:7603:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510299.002089:0:7603:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788510299.002167:0:7603:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788510299.012472:0:7603:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510299.012746:0:7603:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788510299.012969:0:7603:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510299.013404:0:7603:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788510299.013646:0:7603:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510299.013881:0:7603:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788510299.018421:0:7603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788510299.223062:0:7603:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788510299.223069:0:7603:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788510299.223194:0:7603:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788510299.223270:0:7603:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788510299.223285:0:7603:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788510299.223324:0:7603:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788510299.398836:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510299.857031:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861007872:0@lo:13: 00000100:00100000:1.0:1788510299.858996:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510299.859260:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861007872 00000100:00100000:0.0:1788510299.859270:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861007872 00000100:00100000:0.0:1788510299.859336:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788510299.859346:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861007872:12345-0@lo:13: 00002000:00000024:0.0:1788510299.859386:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510299.859447:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861007872:12345-0@lo:13: Request processed in 102us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510299.859454:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788510299.859624:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab4e9b100 x1875388861007872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510299.859648:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861007872:0@lo:13: 00010000:00010000:3.0:1788510300.421766:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510301.457852:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510302.469134:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510303.492482:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510304.456810:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861008000:0@lo:400: 00000100:00100000:2.0:1788510304.456879:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510304.456929:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861008512:0@lo:400: 00000100:00100000:2.0:1788510304.456955:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510304.456980:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788510304.456985:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861008384:0@lo:400: 00000100:00100000:1.0:1788510304.457151:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861008000 00000100:00100000:1.0:1788510304.457158:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861008000 00000100:00100000:1.0:1788510304.457200:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788510304.457207:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:3289:x1875388861008000:12345-0@lo:400: 00000100:00100000:1.0:1788510304.457269:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:3289:x1875388861008000:12345-0@lo:400: Request processed in 62us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510304.457277:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788510304.457316:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861008256:0@lo:400: 00000100:00100000:1.0:1788510304.457340:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510304.457358:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510304.457363:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861008128:0@lo:400: 00000100:00100000:1.0:1788510304.457381:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510304.457430:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861008512 00000100:00100000:1.0:1788510304.457433:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861008512 00000100:00100000:1.0:1788510304.457458:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861008256 00000100:00100000:1.0:1788510304.457460:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861008256 00000100:00100000:1.0:1788510304.457470:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861008128 00000100:00100000:1.0:1788510304.457472:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861008128 00000100:00100000:1.0:1788510304.457482:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788510304.457487:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861008512:12345-0@lo:400: 00000100:00100000:1.0:1788510304.457515:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861008512:12345-0@lo:400: Request processed in 28us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510304.457520:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788510304.457530:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788510304.457534:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861008256:12345-0@lo:400: 00000100:00100000:1.0:1788510304.457571:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861008256:12345-0@lo:400: Request processed in 36us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510304.457577:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788510304.457587:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788510304.457592:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861008128:12345-0@lo:400: 00000100:00100000:1.0:1788510304.457618:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861008128:12345-0@lo:400: Request processed in 26us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510304.457624:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788510304.457640:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788510304.457663:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a89047480 x1875388861008128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510304.457676:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861008128:0@lo:400: 00010000:00080000:1.0:1788510304.457685:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a89046d80 x1875388861008256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510304.457704:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861008256:0@lo:400: 00000100:00100000:2.0:1788510304.458353:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510304.458382:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861008000:0@lo:400: 00010000:00080000:2.0:1788510304.458405:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a89044380 x1875388861008512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510304.458413:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861008512:0@lo:400: 00000100:00100000:2.0:1788510304.458447:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861008384 00000100:00100000:2.0:1788510304.458451:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861008384 00000100:00100000:2.0:1788510304.458485:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788510304.458492:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861008384:12345-0@lo:400: 00000100:00100000:2.0:1788510304.458524:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861008384:12345-0@lo:400: Request processed in 34us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510304.458530:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788510304.458554:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a89045180 x1875388861008384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510304.458562:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861008384:0@lo:400: 00000100:00080000:1.0:1788510304.462512:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788510304.518571:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510304.965047:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788510304.965082:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861008640:0@lo:13: 00000100:00100000:2.0:1788510304.965147:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510304.965592:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861008640 00000100:00100000:0.0:1788510304.965606:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861008640 00000100:00100000:0.0:1788510304.965662:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788510304.965671:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861008640:12345-0@lo:13: 00002000:00000024:0.0:1788510304.965706:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510304.965773:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861008640:12345-0@lo:13: Request processed in 102us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510304.965780:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788510304.965819:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a89045180 x1875388861008640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510304.965836:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861008640:0@lo:13: 00010000:00010000:3.0:1788510305.543991:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788510305.941730:0:7960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788510306.565529:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788510307.013630:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788510307.013638:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff929ab4b11000 from 30 10000000:01000000:1.0:1788510307.013644:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788510307.013785:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.013798:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.013811:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510307.013838:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861008768:0@lo:101: 00000100:00100000:1.0:1788510307.013932:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.013982:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884f4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.014297:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861008768 00000100:00100000:3.0:1788510307.014325:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861008768 00000100:00100000:3.0:1788510307.014400:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788510307.014410:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388861008768:12345-0@lo:101: 00010000:00010000:3.0:1788510307.014424:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510307.014440:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81532e00/0x3e734462ed652c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed652bf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.014468:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81532e00/0x3e734462ed652c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed652bf expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.014479:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81532e00/0x3e734462ed652c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed652bf expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.014491:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81532e00, rc 0) 00000100:00100000:3.0:1788510307.014534:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861008768:12345-0@lo:101: Request processed in 125us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.014540:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788510307.014599:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861008768:0@lo:101: 00010000:00010000:3.0:1788510307.014614:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.014623:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510307.014678:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861008896:0@lo:501: 00000100:00100000:3.0:1788510307.014705:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.014726:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a91f6fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.014739:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861008896 00000100:00100000:3.0:1788510307.014743:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861008896 00000100:00100000:3.0:1788510307.014772:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788510307.014779:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861008896:12345-0@lo:501: 00000100:00100000:3.0:1788510307.015325:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861008896:12345-0@lo:501: Request processed in 545us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.015333:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788510307.015381:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861008896:0@lo:501: 00000100:00100000:3.0:1788510307.015412:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861009024:0@lo:503: 00000100:00100000:3.0:1788510307.015448:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.015462:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a91f6fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.015474:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861009024 00000100:00100000:3.0:1788510307.015478:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861009024 00000100:00100000:3.0:1788510307.015501:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788510307.015507:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861009024:12345-0@lo:503: 00000100:00100000:3.0:1788510307.015763:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861009024:12345-0@lo:503: Request processed in 255us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.015770:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788510307.015807:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861009024:0@lo:503: 00000100:00100000:3.0:1788510307.017477:0:8015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8015:1875388861009152:0@lo:502: 00000100:00100000:3.0:1788510307.017554:0:8015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.017597:0:8015:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aae6a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788510307.017700:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861009152 00000100:00100000:1.0:1788510307.017708:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861009152 00000100:00100000:1.0:1788510307.017747:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788510307.017756:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:8015:x1875388861009152:12345-0@lo:502: 00000100:00100000:1.0:1788510307.018082:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:8015:x1875388861009152:12345-0@lo:502: Request processed in 325us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510307.018089:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788510307.018397:0:8015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8015:1875388861009152:0@lo:502: 00000100:00100000:3.0:1788510307.018446:0:8015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8015:1875388861009280:0@lo:502: 00000100:00100000:3.0:1788510307.018479:0:8015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.018508:0:8015:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aae6a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788510307.020011:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861009280 00000100:00100000:1.0:1788510307.020023:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861009280 00000100:00100000:1.0:1788510307.020098:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788510307.020108:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:8015:x1875388861009280:12345-0@lo:502: 00000100:00100000:1.0:1788510307.020628:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:8015:x1875388861009280:12345-0@lo:502: Request processed in 521us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510307.020637:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788510307.023527:0:8015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8015:1875388861009280:0@lo:502: 00000040:00080000:3.0:1788510307.026300:0:8015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788510307.027359:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788510307.027386:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788510307.027398:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510307.027411:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510307.027421:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788510307.027424:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788510307.027426:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788510307.027465:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510307.027473:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510307.027484:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510307.027517:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861009408:0@lo:101: 00000100:00100000:0.0:1788510307.027582:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510307.027627:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8314fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.027923:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861009408 00000100:00100000:3.0:1788510307.027931:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861009408 00000100:00100000:3.0:1788510307.027987:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788510307.027997:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861009408:12345-0@lo:101: 00010000:00010000:3.0:1788510307.028009:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510307.028021:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81532800/0x3e734462ed652d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed652cd expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.028053:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81532800/0x3e734462ed652d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed652cd expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.028065:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81532800/0x3e734462ed652d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed652cd expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.028073:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81532800, rc 0) 00000100:00100000:3.0:1788510307.028116:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861009408:12345-0@lo:101: Request processed in 120us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.028123:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788510307.028167:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861009408:0@lo:101: 00010000:00010000:3.0:1788510307.028181:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.028190:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510307.028264:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861009536:0@lo:501: 00000100:00100000:3.0:1788510307.028289:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.028304:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aae6a99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.028318:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861009536 00000100:00100000:3.0:1788510307.028340:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861009536 00000100:00100000:3.0:1788510307.028372:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788510307.028379:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861009536:12345-0@lo:501: 00000100:00100000:3.0:1788510307.028609:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861009536:12345-0@lo:501: Request processed in 230us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.028617:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788510307.028646:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861009536:0@lo:501: 00000100:00100000:3.0:1788510307.028672:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861009664:0@lo:503: 00000100:00100000:3.0:1788510307.028708:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.028721:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aae6a99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.028731:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861009664 00000100:00100000:3.0:1788510307.028735:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861009664 00000100:00100000:3.0:1788510307.028755:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788510307.028760:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861009664:12345-0@lo:503: 00000100:00100000:3.0:1788510307.029067:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861009664:12345-0@lo:503: Request processed in 305us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.029074:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788510307.029109:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861009664:0@lo:503: 00000100:00100000:3.0:1788510307.029269:0:8017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8017:1875388861009792:0@lo:502: 00000100:00100000:3.0:1788510307.029300:0:8017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.029316:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861009792 00000100:00100000:3.0:1788510307.029320:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861009792 00000100:00100000:3.0:1788510307.029339:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788510307.029356:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:8017:x1875388861009792:12345-0@lo:502: 00000100:00100000:3.0:1788510307.029495:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:8017:x1875388861009792:12345-0@lo:502: Request processed in 149us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.029509:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788510307.029537:0:8017:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aafdf4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.029549:0:8017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8017:1875388861009792:0@lo:502: 00000020:01000000:3.0:1788510307.029568:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788510307.029577:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510307.029579:0:8017:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788510307.029584:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788510307.029586:0:8017:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788510307.029617:0:8017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8017:1875388861009920:0@lo:502: 00000100:00100000:3.0:1788510307.029647:0:8017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.029665:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861009920 00000100:00100000:3.0:1788510307.029668:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861009920 00000100:00100000:3.0:1788510307.029687:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788510307.029693:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:8017:x1875388861009920:12345-0@lo:502: 00000100:00100000:3.0:1788510307.029793:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:8017:x1875388861009920:12345-0@lo:502: Request processed in 99us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.029799:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788510307.029827:0:8017:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aafdf4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.029837:0:8017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8017:1875388861009920:0@lo:502: 00000020:01000000:3.0:1788510307.029853:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788510307.029857:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510307.029858:0:8017:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788510307.029862:0:8017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788510307.029900:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788510307.029916:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788510307.029924:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.029943:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510307.029951:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788510307.029954:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff929a82ae6000 from 30 10000000:01000000:3.0:1788510307.029957:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788510307.029976:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.029983:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.029992:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510307.030004:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010048:0@lo:101: 00000100:00100000:3.0:1788510307.030027:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.030040:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aafdf4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.030051:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861010048 00000100:00100000:3.0:1788510307.030054:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861010048 00000100:00100000:3.0:1788510307.030072:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788510307.030077:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861010048:12345-0@lo:101: 00010000:00010000:3.0:1788510307.030083:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510307.030093:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81533200/0x3e734462ed652e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed652db expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.030109:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81533200/0x3e734462ed652e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed652db expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.030128:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81533200/0x3e734462ed652e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed652db expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.030136:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81533200, rc 0) 00000100:00100000:3.0:1788510307.030162:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861010048:12345-0@lo:101: Request processed in 85us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.030168:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788510307.030196:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010048:0@lo:101: 00010000:00010000:3.0:1788510307.030206:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.030214:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510307.030268:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010176:0@lo:501: 00000100:00100000:3.0:1788510307.030290:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.030302:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aafdf4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.030312:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861010176 00000100:00100000:3.0:1788510307.030315:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861010176 00000100:00100000:3.0:1788510307.030334:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788510307.030340:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861010176:12345-0@lo:501: 00000100:00100000:3.0:1788510307.030511:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861010176:12345-0@lo:501: Request processed in 171us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.030517:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788510307.030545:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010176:0@lo:501: 00000100:00100000:3.0:1788510307.030565:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010304:0@lo:503: 00000100:00100000:3.0:1788510307.030600:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.030612:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aaf3e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.030622:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861010304 00000100:00100000:3.0:1788510307.030624:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861010304 00000100:00100000:3.0:1788510307.030643:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788510307.030649:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861010304:12345-0@lo:503: 00000100:00100000:3.0:1788510307.030760:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861010304:12345-0@lo:503: Request processed in 111us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.030767:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788510307.030799:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010304:0@lo:503: 00000100:00100000:3.0:1788510307.031024:0:8018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8018:1875388861010432:0@lo:502: 00000100:00100000:3.0:1788510307.031055:0:8018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.031073:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861010432 00000100:00100000:3.0:1788510307.031076:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861010432 00000100:00100000:3.0:1788510307.031096:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788510307.031103:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:8018:x1875388861010432:12345-0@lo:502: 00000100:00100000:3.0:1788510307.031263:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:8018:x1875388861010432:12345-0@lo:502: Request processed in 161us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.031270:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788510307.031297:0:8018:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aaf3e00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.031308:0:8018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8018:1875388861010432:0@lo:502: 00000100:00100000:3.0:1788510307.031343:0:8018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8018:1875388861010560:0@lo:502: 00000100:00100000:3.0:1788510307.048604:0:8018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.048652:0:8018:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aaf3e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510307.048703:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861010560 00000100:00100000:2.0:1788510307.048712:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861010560 00000100:00100000:2.0:1788510307.048765:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788510307.048776:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:8018:x1875388861010560:12345-0@lo:502: 00000100:00100000:2.0:1788510307.049313:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:8018:x1875388861010560:12345-0@lo:502: Request processed in 538us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510307.049455:0:8018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8018:1875388861010560:0@lo:502: 00000040:00080000:1.0:1788510307.049494:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:2.0:1788510307.049628:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000020:01000000:3.0:1788510307.049729:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788510307.049749:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788510307.049767:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.049777:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510307.049788:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788510307.049791:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff929a82ae6000 from 5 10000000:01000000:3.0:1788510307.049793:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788510307.049825:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.049833:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510307.049842:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510307.049860:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010688:0@lo:101: 00000100:00100000:3.0:1788510307.053473:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.053526:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aaf3e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510307.054780:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861010688 00000100:00100000:2.0:1788510307.054794:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861010688 00000100:00100000:2.0:1788510307.054857:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788510307.054867:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861010688:12345-0@lo:101: 00010000:00010000:2.0:1788510307.054894:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510307.054914:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fca00/0x3e734462ed652f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed652e9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510307.054942:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fca00/0x3e734462ed652f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed652e9 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510307.054953:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fca00/0x3e734462ed652f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed652e9 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510307.054973:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fca00, rc 0) 00000100:00100000:2.0:1788510307.055087:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861010688:12345-0@lo:101: Request processed in 222us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510307.055094:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788510307.055277:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010688:0@lo:101: 00010000:00010000:1.0:1788510307.055295:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.055305:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510307.055390:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010816:0@lo:256: 00000100:00100000:1.0:1788510307.055427:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.055450:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884f4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510307.055820:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861010816 00000100:00100000:2.0:1788510307.055832:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861010816 00000100:00100000:2.0:1788510307.055869:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788510307.055884:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861010816:12345-0@lo:256: 20000000:01000000:2.0:1788510307.055898:0:5816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788510307.055911:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788510307.055915:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788510307.056004:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861010816:12345-0@lo:256: Request processed in 128us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510307.056011:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788510307.056268:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010816:0@lo:256: 10000000:01000000:1.0:1788510307.056313:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788510307.056330:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.056340:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510307.056355:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788510307.056358:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788510307.056367:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788510307.056390:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.056397:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.056406:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510307.056420:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010944:0@lo:101: 00000100:00100000:1.0:1788510307.056448:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.056466:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aafe1af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510307.056479:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861010944 00000100:00100000:1.0:1788510307.056483:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861010944 00000100:00100000:1.0:1788510307.056501:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788510307.056506:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861010944:12345-0@lo:101: 00010000:00010000:1.0:1788510307.056513:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510307.056530:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a83033400/0x3e734462ed652fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed652f7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.056548:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83033400/0x3e734462ed652fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed652f7 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.056557:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a83033400/0x3e734462ed652fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed652f7 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.056564:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033400, rc 0) 00000100:00100000:1.0:1788510307.056593:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861010944:12345-0@lo:101: Request processed in 86us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510307.056605:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788510307.056635:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861010944:0@lo:101: 00010000:00010000:1.0:1788510307.056647:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.056656:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510307.056697:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861011072:0@lo:501: 00000100:00100000:1.0:1788510307.056720:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.056733:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aafe1af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510307.056743:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861011072 00000100:00100000:1.0:1788510307.056746:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861011072 00000100:00100000:1.0:1788510307.056761:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788510307.056766:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861011072:12345-0@lo:501: 00000100:00100000:1.0:1788510307.058871:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861011072:12345-0@lo:501: Request processed in 258us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510307.058951:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788510307.059207:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861011072:0@lo:501: 00000100:00100000:1.0:1788510307.059841:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861011200:0@lo:503: 00000100:00100000:1.0:1788510307.060086:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.060155:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c90000 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.069613:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861011200 00000100:00100000:3.0:1788510307.069631:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861011200 00000100:00100000:3.0:1788510307.069703:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788510307.069715:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861011200:12345-0@lo:503: 00000100:00100000:3.0:1788510307.071450:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861011200:12345-0@lo:503: Request processed in 1729us (11355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.071463:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788510307.073495:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861011200:0@lo:503: 00000100:00100000:1.0:1788510307.075541:0:8020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8020:1875388861011328:0@lo:502: 00000100:00100000:1.0:1788510307.075623:0:8020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.075667:0:8020:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510307.076436:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861011328 00000100:00100000:3.0:1788510307.076445:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861011328 00000100:00100000:3.0:1788510307.076507:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788510307.076526:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8020:x1875388861011328:12345-0@lo:502: 00000100:00100000:3.0:1788510307.076852:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8020:x1875388861011328:12345-0@lo:502: Request processed in 326us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.076860:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788510307.078159:0:8020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8020:1875388861011328:0@lo:502: 00000020:01000000:1.0:1788510307.078203:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788510307.078210:0:8020:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788510307.078219:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510307.078246:0:8020:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788510307.078256:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788510307.078260:0:8020:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.104@tcp to nid 0x20000c0a8c968 (192.168.201.104@tcp) 00000020:01000000:1.0:1788510307.078285:0:8020:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788510307.078288:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788510307.078302:0:8020:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff929aafdccd40) 00000020:00000080:1.0:1788510307.078399:0:8020:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788510307.078406:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788510307.078506:0:8020:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788510307.078512:0:8020:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788510307.078522:0:8020:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed6530c 00010000:00080000:1.0:1788510307.078548:0:8020:0:(ldlm_lib.c:102:import_set_conn()) imp ffff929ab7c9f800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.104@tcp at head 00010000:00010000:1.0:1788510307.078761:0:8020:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788510307.079933:0:8020:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788510307.079949:0:8020:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788510307.080528:0:8020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788510307.080728:0:8020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788510307.080781:0:8020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788510307.080840:0:8020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788510307.085544:0:8021:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788510307.085552:0:8021:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788510307.086213:0:8020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788510307.086257:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788510307.086288:0:8020:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788510307.086310:0:8020:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e734462ed65313 00000100:00080000:1.0:1788510307.086722:0:8020:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788510307.086733:0:8020:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff929ab7c9f800 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:1.0:1788510307.086778:0:8020:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929ab4e9ad80 x1875388861011456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788510307.086809:0:8020:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788510307.086854:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861011456:0@lo:8: 00000100:00100000:2.0:1788510307.086928:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510307.087912:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861011456 00000100:00100000:3.0:1788510307.087924:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861011456 00000100:00100000:3.0:1788510307.087971:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788510307.087979:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3287:x1875388861011456:12345-0@lo:8: 00010000:00080000:3.0:1788510307.088015:0:6667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1788510307.088050:0:6667:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e734462ed6531a 00002000:00100000:3.0:1788510307.088065:0:6667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff929aaf3a3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788510307.088069:0:6667:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788510307.088073:0:6667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788510307.088189:0:6667:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788510307.088857:0:6667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788510307.088900:0:6667:0:(import.c:65:import_set_state_nolock()) ffff929aaf3a4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788510307.089096:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1875388861011456:12345-0@lo:8: Request processed in 1115us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.089106:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788510307.090313:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab4e9ad80 x1875388861011456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788510317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510307.090336:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788510307.090355:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788510307.090364:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788510307.090371:0:3287:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788510307.090374:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929ab7c9f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788510307.090394:0:3287:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788510307.090401:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861011456:0@lo:8: 00000004:00080000:0.0:1788510307.091291:0:8021:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788510307.091570:0:8021:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 164910346418ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788510307.097556:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861011584:0@lo:400: 00000100:00100000:2.0:1788510307.097652:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510307.097697:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788510307.097704:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861011968:0@lo:400: 00000100:00100000:2.0:1788510307.097726:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510307.097761:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861011840:0@lo:400: 00000100:00100000:2.0:1788510307.097789:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510307.097827:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788510307.097834:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861011712:0@lo:400: 00000100:00100000:2.0:1788510307.097853:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510307.097876:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861011840 00000100:00100000:1.0:1788510307.098578:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861011584 00000100:00100000:1.0:1788510307.098590:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861011584 00000100:00100000:1.0:1788510307.098631:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861011968 00000100:00100000:1.0:1788510307.098634:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861011968 00000100:00100000:1.0:1788510307.098655:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861011712 00000100:00100000:1.0:1788510307.098658:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861011712 00000100:00100000:1.0:1788510307.098675:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788510307.098684:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861011584:12345-0@lo:400: 00000100:00100000:1.0:1788510307.098760:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861011584:12345-0@lo:400: Request processed in 76us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510307.098768:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788510307.098785:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788510307.098791:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861011968:12345-0@lo:400: 00000100:00100000:1.0:1788510307.098820:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861011968:12345-0@lo:400: Request processed in 29us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510307.098825:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788510307.098836:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788510307.098841:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861011712:12345-0@lo:400: 00000100:00100000:1.0:1788510307.098870:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861011712:12345-0@lo:400: Request processed in 29us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510307.098876:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788510307.099808:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861011840 00000100:00080000:1.0:1788510307.101334:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788510307.101550:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a89045180 x1875388861011712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510307.101581:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861011712:0@lo:400: 00010000:00080000:1.0:1788510307.101631:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a89047480 x1875388861011968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510307.101640:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861011968:0@lo:400: 00010000:00080000:1.0:1788510307.101653:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a89045c00 x1875388861011584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510307.101661:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861011584:0@lo:400: 00000020:01000000:1.0:1788510307.101748:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510307.101755:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510307.101757:0:8020:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788510307.101761:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510307.101765:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510307.101766:0:8020:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788510307.101769:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788510307.101771:0:8020:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788510307.101813:0:8020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8020:1875388861012096:0@lo:502: 00000100:00100000:2.0:1788510307.103273:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788510307.103286:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861011840:12345-0@lo:400: 00000100:00100000:1.0:1788510307.106629:0:8020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510307.106741:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861011840:12345-0@lo:400: Request processed in 3455us (8947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510307.106755:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788510307.107067:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510307.107177:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861012096 00000100:00100000:1.0:1788510307.107185:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861012096 00000100:00100000:1.0:1788510307.107245:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788510307.107254:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8020:x1875388861012096:12345-0@lo:502: 00000100:00100000:1.0:1788510307.107520:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8020:x1875388861012096:12345-0@lo:502: Request processed in 268us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510307.107528:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:1.0:1788510307.107590:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a89046d80 x1875388861011840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510307.107609:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861011840:0@lo:400: 00000100:00100000:1.0:1788510307.107644:0:8020:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aaf3e03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788510307.107654:0:8020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8020:1875388861012096:0@lo:502: 00000020:01000000:1.0:1788510307.107680:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510307.107687:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510307.107690:0:8020:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788510307.107697:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788510307.107753:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788510307.107767:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788510307.107776:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.107787:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510307.107797:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788510307.107800:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff929a84fbcd40 from 1 10000000:01000000:1.0:1788510307.107802:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788510307.107832:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.107841:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.107850:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510307.107868:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861012224:0@lo:101: 00000100:00100000:1.0:1788510307.107923:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.107939:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85306480 going to sleep for 11 seconds 00000100:00100000:1.0:1788510307.107952:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861012224 00000100:00100000:1.0:1788510307.107955:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861012224 00000100:00100000:1.0:1788510307.107977:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788510307.107984:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861012224:12345-0@lo:101: 00010000:00010000:1.0:1788510307.110353:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510307.110381:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a83033000/0x3e734462ed65328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65321 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.110413:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83033000/0x3e734462ed65328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65321 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.110425:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a83033000/0x3e734462ed65328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65321 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.110433:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033000, rc 0) 00000100:00100000:1.0:1788510307.110508:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861012224:12345-0@lo:101: Request processed in 2523us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510307.110515:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788510307.120106:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861012224:0@lo:101: 00010000:00010000:1.0:1788510307.120135:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.120148:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510307.120255:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861012352:0@lo:501: 00000100:00100000:1.0:1788510307.120327:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.120382:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85306480 going to sleep for 11 seconds 00000100:00100000:0.0:1788510307.121563:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861012352 00000100:00100000:0.0:1788510307.121573:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861012352 00000100:00100000:0.0:1788510307.121630:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788510307.121639:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861012352:12345-0@lo:501: 00000100:00100000:0.0:1788510307.121899:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861012352:12345-0@lo:501: Request processed in 260us (1571us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788510307.121906:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788510307.122454:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861012352:0@lo:501: 10000000:01000000:1.0:1788510307.122488:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788510307.122497:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510307.122508:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788510307.222320:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788510307.317179:0:8022:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788510307.317211:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875388861012608:0@lo:7: 00000100:00100000:2.0:1788510307.317304:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510307.317361:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7d9cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510307.317375:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788510307.317387:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861012480:0@lo:13: 00000100:00100000:2.0:1788510307.317414:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510307.317572:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861012480 00000100:00100000:0.0:1788510307.317581:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861012480 00000100:00100000:0.0:1788510307.317767:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788510307.317777:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861012480:12345-0@lo:13: 00002000:00000024:0.0:1788510307.317807:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788510307.317858:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861012480:12345-0@lo:13: Request processed in 81us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510307.317864:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788510307.317921:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd7100 x1875388861012480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510307.317939:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861012480:0@lo:13: 00000100:00100000:3.0:1788510307.318464:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861012608 00000100:00100000:3.0:1788510307.318471:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861012608 00000100:00100000:3.0:1788510307.318520:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788510307.318528:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8022:x1875388861012608:12345-0@lo:7: 00000100:00080000:2.0:1788510307.320059:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788510307.351101:0:6669:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788510307.351112:0:6669:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788510307.351859:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8022:x1875388861012608:12345-0@lo:7: Request processed in 33327us (34549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510307.351870:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788510307.358414:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd5f80 x1875388861012608/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788510323 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510307.358434:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875388861012608:0@lo:7: 00000004:00080000:2.0:1788510307.358452:0:8022:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788510307.360739:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875388861012736:0@lo:5: 00000100:00100000:1.0:1788510307.360810:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.360878:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788510307.361115:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861012736 00000100:00100000:2.0:1788510307.361123:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861012736 00000100:00100000:2.0:1788510307.361185:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788510307.361512:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8022:x1875388861012736:12345-0@lo:5: 00002000:00080000:2.0:1788510307.361539:0:6670:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788510307.361553:0:6670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788510307.361904:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8022:x1875388861012736:12345-0@lo:5: Request processed in 710us (1093us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788510307.361911:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788510307.362926:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab4e99500 x1875388861012736/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788510323 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510307.362954:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875388861012736:0@lo:5: 00000004:00080000:1.0:1788510307.362971:0:8022:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788510307.363017:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875388861012864:0@lo:700: 00000100:00100000:1.0:1788510307.363056:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.363082:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788510307.363103:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861012864 00000100:00100000:1.0:1788510307.363108:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861012864 00000100:00100000:1.0:1788510307.363148:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510307.363155:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8022:x1875388861012864:12345-0@lo:700: 00000100:00100000:1.0:1788510307.363188:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6676:1875388861012992:0@lo:700: 00000100:00100000:1.0:1788510307.363256:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.363283:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788510307.363302:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861012992 00000100:00100000:1.0:1788510307.363305:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861012992 00000100:00100000:1.0:1788510307.363330:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510307.363336:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6676:x1875388861012992:12345-0@lo:700: 40000000:02000000:2.0:1788510307.458478:0:5828:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788510307.482721:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6676:x1875388861012992:12345-0@lo:700: Request processed in 119375us (119454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510307.482741:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788510307.482796:0:6676:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab4e9aa00 x1875388861012992/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788510323 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510307.482813:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6676:1875388861012992:0@lo:700: 40000000:02000000:2.0:1788510307.482830:0:6676:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:1.0:1788510307.599768:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788510307.734901:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788510307.734920:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788510307.739166:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8022:x1875388861012864:12345-0@lo:700: Request processed in 376002us (376100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510307.739198:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788510307.739820:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab4e9ad80 x1875388861012864/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788510323 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510307.739850:0:8022:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788510307.739875:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875388861012864:0@lo:700: 00000004:02000040:1.0:1788510307.834276:0:8022:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788510307.840499:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875388861013120:0@lo:5: 00000100:00100000:1.0:1788510307.840574:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510307.840632:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510307.842569:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861013120 00000100:00100000:2.0:1788510307.842579:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861013120 00000100:00100000:2.0:1788510307.842635:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788510307.842646:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8022:x1875388861013120:12345-0@lo:5: 00002000:00080000:2.0:1788510307.854772:0:6669:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788510307.854792:0:6669:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788510307.862764:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8022:x1875388861013120:12345-0@lo:5: Request processed in 20113us (22184us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788510307.862776:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788510307.863341:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab4e9ad80 x1875388861013120/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788510323 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510307.863361:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8022:1875388861013120:0@lo:5: 00000004:00080000:1.0:1788510307.863377:0:8022:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788510308.612578:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510309.636520:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510310.085456:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788510310.085491:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861013248:0@lo:13: 00000100:00100000:0.0:1788510310.085558:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510310.085664:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861013248 00000100:00100000:2.0:1788510310.085672:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861013248 00000100:00100000:2.0:1788510310.085728:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788510310.085737:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861013248:12345-0@lo:13: 00002000:00000024:2.0:1788510310.085772:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510310.085810:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861013248:12345-0@lo:13: Request processed in 74us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510310.085816:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788510310.085854:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd5f80 x1875388861013248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510310.085870:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861013248:0@lo:13: 00000100:00080000:0.0:1788510310.085928:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788510310.691067:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510311.684991:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788510311.901601:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788510312.137102:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861013760:0@lo:400: 00000100:00100000:3.0:1788510312.137171:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510312.137241:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788510312.137247:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861013376:0@lo:400: 00000100:00100000:3.0:1788510312.137290:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510312.137313:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861013888:0@lo:400: 00000100:00100000:3.0:1788510312.137339:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510312.137366:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861013632:0@lo:400: 00000100:00100000:3.0:1788510312.137404:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510312.137428:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788510312.137434:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861013504:0@lo:400: 00000100:00100000:3.0:1788510312.137457:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510312.137473:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861014016:0@lo:400: 00000100:00100000:3.0:1788510312.137495:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510312.137527:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861013376 00000100:00100000:3.0:1788510312.137535:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861013376 00000100:00100000:3.0:1788510312.137578:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788510312.137587:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861013376:12345-0@lo:400: 00000100:00100000:3.0:1788510312.137634:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861013376:12345-0@lo:400: Request processed in 48us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510312.137640:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788510312.137669:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861013888 00000100:00100000:3.0:1788510312.137673:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861013888 00000100:00100000:3.0:1788510312.137699:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861013632 00000100:00100000:3.0:1788510312.137708:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861013632 00000100:00100000:3.0:1788510312.137726:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861013504 00000100:00100000:3.0:1788510312.137729:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861013504 00000100:00100000:3.0:1788510312.137739:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788510312.137745:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861013888:12345-0@lo:400: 00000100:00100000:3.0:1788510312.137776:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861013888:12345-0@lo:400: Request processed in 31us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510312.137782:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788510312.137793:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788510312.137799:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861013632:12345-0@lo:400: 00000100:00100000:3.0:1788510312.137829:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861013632:12345-0@lo:400: Request processed in 30us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510312.137835:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788510312.137846:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788510312.137851:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861013504:12345-0@lo:400: 00000100:00100000:2.0:1788510312.138026:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861013760 00000100:00100000:2.0:1788510312.138031:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861013760 00000100:00100000:2.0:1788510312.138061:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861014016 00000100:00100000:2.0:1788510312.138063:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861014016 00000100:00100000:2.0:1788510312.138080:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788510312.138086:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861013760:12345-0@lo:400: 00000100:00100000:3.0:1788510312.138129:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861013504:12345-0@lo:400: Request processed in 277us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510312.138134:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788510312.139421:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788510312.139430:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788510312.139433:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510312.140344:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788510312.140371:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788510312.140393:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788510312.140407:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788510312.140421:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861014016:12345-0@lo:400: 00000100:00100000:2.0:1788510312.140785:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861013760:12345-0@lo:400: Request processed in 2697us (3612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510312.140794:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788510312.144414:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab50ed880 x1875388861013504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510312.144435:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861013504:0@lo:400: 00000100:00100000:1.0:1788510312.144728:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861014016:12345-0@lo:400: Request processed in 4309us (7228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510312.144740:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788510312.145310:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861013376:0@lo:400: 00010000:00080000:2.0:1788510312.145328:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab50eea00 x1875388861013888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510312.145339:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861013888:0@lo:400: 00010000:00080000:2.0:1788510312.145351:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab50edf80 x1875388861013760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510312.145359:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861013760:0@lo:400: 00010000:00080000:3.0:1788510312.146507:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab50ee680 x1875388861014016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510312.146519:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788510312.146540:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861014016:0@lo:400: 00010000:00080000:3.0:1788510312.146555:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab50ef100 x1875388861013632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510312.146572:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861013632:0@lo:400: 00000100:00100000:1.0:1788510312.558582:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510312.558621:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852600960 00000100:00100000:1.0:1788510312.558632:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852600960 00000100:00100000:1.0:1788510312.558694:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 112 00000100:00100000:1.0:1788510312.558702:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2339:x1875388852600960:12345-192.168.201.4@tcp:250: 00010000:00080000:1.0:1788510312.558732:0:5816:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 58dadbea-4c8c-47ce-beef-15ce80e646ee@192.168.201.4@tcp t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:1.0:1788510312.558776:0:5816:0:(genops.c:1385:class_connect()) connect: client 58dadbea-4c8c-47ce-beef-15ce80e646ee, cookie 0x3e734462ed6532f 00000100:00080000:1.0:1788510312.559376:0:5816:0:(import.c:65:import_set_state_nolock()) ffff929ab7c9a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788510312.559445:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+5:2339:x1875388852600960:12345-192.168.201.4@tcp:250: Request processed in 743us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510312.559453:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 112 00000100:00100000:1.0:1788510312.566012:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510312.566051:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852601088 00000100:00100000:1.0:1788510312.566062:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852601088 00000100:00100000:1.0:1788510312.566105:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 113 00000100:00100000:1.0:1788510312.566114:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+5:5570:x1875388852601088:12345-192.168.201.4@tcp:101: 00010000:00010000:1.0:1788510312.566131:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510312.566147:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a83032c00/0x3e734462ed65336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc730d5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510312.566174:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83032c00/0x3e734462ed65336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730d5 expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510312.566209:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a83032c00/0x3e734462ed65336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730d5 expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510312.566219:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032c00, rc 0) 00000100:00100000:1.0:1788510312.568578:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+6:5570:x1875388852601088:12345-192.168.201.4@tcp:101: Request processed in 2457us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510312.568590:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 113 00000100:00100000:1.0:1788510312.591502:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510312.591725:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852601216 00000100:00100000:0.0:1788510312.591736:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852601216 00000100:00100000:0.0:1788510312.591792:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 114 00000100:00100000:0.0:1788510312.591802:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+6:5570:x1875388852601216:12345-192.168.201.4@tcp:501: 00000100:00100000:0.0:1788510312.592110:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+6:5570:x1875388852601216:12345-192.168.201.4@tcp:501: Request processed in 308us (615us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788510312.592118:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 114 00000100:00100000:3.0:1788510312.606288:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510312.606523:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852601344 00000100:00100000:1.0:1788510312.606534:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852601344 00000100:00100000:1.0:1788510312.606595:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 115 00000100:00100000:1.0:1788510312.606606:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+6:5570:x1875388852601344:12345-192.168.201.4@tcp:101: 00010000:00010000:1.0:1788510312.606628:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510312.606648:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a83033800/0x3e734462ed6533d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc730dc expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510312.606684:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83033800/0x3e734462ed6533d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730dc expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510312.606698:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a83033800/0x3e734462ed6533d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730dc expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510312.606710:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033800, rc 0) 00000100:00100000:1.0:1788510312.606777:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+7:5570:x1875388852601344:12345-192.168.201.4@tcp:101: Request processed in 173us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510312.606784:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 115 00000100:00100000:3.0:1788510312.610188:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510312.610293:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852601472 00000100:00100000:1.0:1788510312.610317:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852601472 00000100:00100000:1.0:1788510312.610373:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 116 00000100:00100000:1.0:1788510312.610382:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+7:5570:x1875388852601472:12345-192.168.201.4@tcp:501: 00000100:00100000:1.0:1788510312.610722:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+8:5570:x1875388852601472:12345-192.168.201.4@tcp:501: Request processed in 340us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510312.610731:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 116 00000100:00100000:1.0:1788510312.620348:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510312.620874:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852601600 00000100:00100000:0.0:1788510312.620885:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852601600 00000100:00100000:0.0:1788510312.620949:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 117 00000100:00100000:0.0:1788510312.620960:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+8:5570:x1875388852601600:12345-192.168.201.4@tcp:503: 00000100:00100000:0.0:1788510312.621384:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+8:5570:x1875388852601600:12345-192.168.201.4@tcp:503: Request processed in 424us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510312.621392:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 117 00000100:00100000:3.0:1788510312.645263:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861014144:0@lo:13: 00000100:00100000:3.0:1788510312.645335:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510312.645447:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861014144 00000100:00100000:2.0:1788510312.645455:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861014144 00000100:00100000:2.0:1788510312.645525:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788510312.645534:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861014144:12345-0@lo:13: 00002000:00000024:2.0:1788510312.645572:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510312.645622:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861014144:12345-0@lo:13: Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510312.645629:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788510312.645747:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd5f80 x1875388861014144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510312.645766:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861014144:0@lo:13: 00000100:00100000:1.0:1788510312.667916:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510312.668478:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852601728 00000100:00100000:3.0:1788510312.668490:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852601728 00000100:00100000:3.0:1788510312.668554:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 118 00000100:00100000:3.0:1788510312.668565:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+8:5589:x1875388852601728:12345-192.168.201.4@tcp:502: 00000100:00100000:3.0:1788510312.668931:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+8:5589:x1875388852601728:12345-192.168.201.4@tcp:502: Request processed in 367us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510312.668940:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 118 00010000:00010000:2.0:1788510312.710176:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510312.721930:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510312.722139:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852601856 00000100:00100000:3.0:1788510312.722150:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852601856 00000100:00100000:3.0:1788510312.722208:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 119 00000100:00100000:3.0:1788510312.722220:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+8:5589:x1875388852601856:12345-192.168.201.4@tcp:502: 00000100:00100000:3.0:1788510312.722524:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+8:5589:x1875388852601856:12345-192.168.201.4@tcp:502: Request processed in 304us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510312.722532:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 119 00000100:00100000:2.0:1788510312.734537:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510312.735427:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852601984 00000100:00100000:1.0:1788510312.735438:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852601984 00000100:00100000:1.0:1788510312.735486:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 120 00000100:00100000:1.0:1788510312.735495:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+8:5570:x1875388852601984:12345-192.168.201.4@tcp:101: 00010000:00010000:1.0:1788510312.735511:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510312.735527:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a83033a00/0x3e734462ed65344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73106 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510312.735553:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83033a00/0x3e734462ed65344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73106 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510312.735564:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a83033a00/0x3e734462ed65344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73106 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510312.735574:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033a00, rc 0) 00000100:00100000:1.0:1788510312.735630:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:5570:x1875388852601984:12345-192.168.201.4@tcp:101: Request processed in 136us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510312.735636:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 120 00000100:00100000:1.0:1788510312.741586:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510312.741857:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852602112 00000100:00100000:3.0:1788510312.741874:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852602112 00000100:00100000:3.0:1788510312.741934:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 121 00000100:00100000:3.0:1788510312.741943:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:5570:x1875388852602112:12345-192.168.201.4@tcp:256: 20000000:01000000:3.0:1788510312.741969:0:5816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788510312.741987:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788510312.741991:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788510312.741993:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788510312.741996:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788510312.745650:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:5570:x1875388852602112:12345-192.168.201.4@tcp:256: Request processed in 3697us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510312.745666:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 121 00000100:00100000:1.0:1788510312.753402:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510312.753499:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852602240 00000100:00100000:0.0:1788510312.753510:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852602240 00000100:00100000:0.0:1788510312.753557:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 122 00000100:00100000:0.0:1788510312.753566:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:5570:x1875388852602240:12345-192.168.201.4@tcp:101: 00010000:00010000:0.0:1788510312.753583:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510312.753602:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a80030a00/0x3e734462ed6534b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7310d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510312.753641:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80030a00/0x3e734462ed6534b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7310d expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510312.753653:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a80030a00/0x3e734462ed6534b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7310d expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510312.753662:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a80030a00, rc 0) 00000100:00100000:0.0:1788510312.753724:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5570:x1875388852602240:12345-192.168.201.4@tcp:101: Request processed in 159us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510312.753732:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 122 00000100:00100000:0.0:1788510312.760791:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510312.761939:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852602368 00000100:00100000:3.0:1788510312.761952:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852602368 00000100:00100000:3.0:1788510312.762011:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 123 00000100:00100000:3.0:1788510312.762021:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5570:x1875388852602368:12345-192.168.201.4@tcp:501: 00000100:00100000:3.0:1788510312.762293:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5570:x1875388852602368:12345-192.168.201.4@tcp:501: Request processed in 272us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510312.762302:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 123 00000100:00100000:0.0:1788510312.765116:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510312.775871:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852602496 00000100:00100000:2.0:1788510312.775887:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852602496 00000100:00100000:2.0:1788510312.775950:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 124 00000100:00100000:2.0:1788510312.775960:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5570:x1875388852602496:12345-192.168.201.4@tcp:503: 00000100:00100000:2.0:1788510312.776326:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5570:x1875388852602496:12345-192.168.201.4@tcp:503: Request processed in 366us (11221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510312.776334:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 124 00000100:00100000:1.0:1788510312.786309:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510312.789057:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852602624 00000100:00100000:1.0:1788510312.789070:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852602624 00000100:00100000:1.0:1788510312.789131:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 125 00000100:00100000:1.0:1788510312.789142:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5593:x1875388852602624:12345-192.168.201.4@tcp:502: 00000100:00100000:1.0:1788510312.789434:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5593:x1875388852602624:12345-192.168.201.4@tcp:502: Request processed in 294us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510312.789442:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 125 00000100:00100000:1.0:1788510312.795968:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510312.796419:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852602752 00000100:00100000:0.0:1788510312.796430:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852602752 00000100:00100000:0.0:1788510312.796477:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 126 00000100:00100000:0.0:1788510312.796486:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5593:x1875388852602752:12345-192.168.201.4@tcp:502: 00000100:00100000:0.0:1788510312.796699:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5593:x1875388852602752:12345-192.168.201.4@tcp:502: Request processed in 212us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510312.796707:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 126 00000100:00100000:3.0:1788510312.800070:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510312.800154:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852602880 00000100:00100000:1.0:1788510312.800164:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852602880 00000100:00100000:1.0:1788510312.800214:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:1.0:1788510312.800268:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2339:x1875388852602880:12345-192.168.201.4@tcp:38: 00010000:00080000:1.0:1788510312.800298:0:5821:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:1.0:1788510312.800349:0:5821:0:(genops.c:1385:class_connect()) connect: client cef40ebf-ceed-4c16-b27b-e8bced3a8d2f, cookie 0x3e734462ed65352 00000004:00100000:1.0:1788510312.800377:0:5821:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:1.0:1788510312.800384:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788510312.903924:0:5821:0:(import.c:65:import_set_state_nolock()) ffff929ab7c9d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788510312.904022:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2339:x1875388852602880:12345-192.168.201.4@tcp:38: Request processed in 103797us (103960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510312.904033:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:1.0:1788510313.667127:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510313.667325:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852603008 00000100:00100000:2.0:1788510313.667335:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852603008 00000100:00100000:2.0:1788510313.667402:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 5 00000100:00100000:2.0:1788510313.667412:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:0:x1875388852603008:12345-192.168.201.4@tcp:41: 00000004:00000024:2.0:1788510313.667452:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788510313.667829:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:0:x1875388852603008:12345-192.168.201.4@tcp:41: Request processed in 418us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510313.667838:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 5 00000100:00080000:0.0:1788510313.667934:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510313.685199:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510313.687928:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852603136 00000100:00100000:0.0:1788510313.687945:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852603136 00000100:00100000:0.0:1788510313.688024:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:0.0:1788510313.688034:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:5570:x1875388852603136:12345-192.168.201.4@tcp:41: 00000004:00000024:0.0:1788510313.688064:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788510313.694090:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:5570:x1875388852603136:12345-192.168.201.4@tcp:41: Request processed in 6045us (8889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510313.694116:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:1.0:1788510313.698360:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510313.698473:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852603264 00000100:00100000:3.0:1788510313.698482:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852603264 00000100:00100000:3.0:1788510313.698547:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:3.0:1788510313.698557:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:5570:x1875388852603264:12345-192.168.201.4@tcp:40: 00000100:00100000:3.0:1788510313.698643:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:5570:x1875388852603264:12345-192.168.201.4@tcp:40: Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510313.698651:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:1.0:1788510313.714957:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510313.715041:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510313.715072:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510313.715119:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510313.715154:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852603776 00000100:00100000:1.0:1788510313.715163:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852603776 00000100:00100000:1.0:1788510313.715204:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:1.0:1788510313.715213:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:5570:x1875388852603776:12345-192.168.201.4@tcp:33: 00000100:00100000:0.0:1788510313.715762:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852603392 00000100:00100000:0.0:1788510313.715769:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852603392 00000100:00100000:0.0:1788510313.715794:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852603648 00000100:00100000:0.0:1788510313.715796:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852603648 00000100:00100000:0.0:1788510313.715811:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:0.0:1788510313.715817:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2339:x1875388852603392:12345-192.168.201.4@tcp:8: 00010000:00080000:0.0:1788510313.715855:0:6669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:0.0:1788510313.715889:0:6669:0:(genops.c:1385:class_connect()) connect: client cef40ebf-ceed-4c16-b27b-e8bced3a8d2f, cookie 0x3e734462ed65359 00002000:00100000:0.0:1788510313.715899:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cef40ebf-ceed-4c16-b27b-e8bced3a8d2f/ffff929a87d53800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788510313.715921:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788510313.716303:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788510313.716334:0:6669:0:(import.c:65:import_set_state_nolock()) ffff929a87d55800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788510313.716392:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2339:x1875388852603392:12345-192.168.201.4@tcp:8: Request processed in 574us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510313.716399:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:0.0:1788510313.716416:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:0.0:1788510313.716421:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2339:x1875388852603648:12345-192.168.201.4@tcp:8: 00010000:00080000:0.0:1788510313.716435:0:6669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:0.0:1788510313.716453:0:6669:0:(genops.c:1385:class_connect()) connect: client cef40ebf-ceed-4c16-b27b-e8bced3a8d2f, cookie 0x3e734462ed65360 00002000:00100000:0.0:1788510313.716458:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cef40ebf-ceed-4c16-b27b-e8bced3a8d2f/ffff929a85c68000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788510313.716463:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788510313.716720:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788510313.716734:0:6669:0:(import.c:65:import_set_state_nolock()) ffff929a85c6b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788510313.716768:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2339:x1875388852603648:12345-192.168.201.4@tcp:8: Request processed in 345us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510313.716776:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:2.0:1788510313.731355:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852603520 00000100:00100000:2.0:1788510313.731370:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852603520 00000100:00100000:0.0:1788510313.732790:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 127 00000100:00100000:0.0:1788510313.732803:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2340:x1875388852603520:12345-192.168.201.4@tcp:400: 00000100:00100000:0.0:1788510313.732889:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2340:x1875388852603520:12345-192.168.201.4@tcp:400: Request processed in 88us (17940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510313.732897:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 127 00010000:00010000:3.0:1788510313.733431:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788510313.753294:0:5824:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34909us 00000004:00200000:3.0:1788510313.762910:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788510313.763031:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:5570:x1875388852603776:12345-192.168.201.4@tcp:33: Request processed in 47814us (47906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510313.763045:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:0.0:1788510313.919342:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510313.919818:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852603904 00000100:00100000:1.0:1788510313.919828:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852603904 00000100:00100000:1.0:1788510313.919943:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:1.0:1788510313.919953:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:5610:x1875388852603904:12345-192.168.201.4@tcp:101: 00010000:00010000:1.0:1788510313.919971:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510313.919995:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73137 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510313.920055:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032800/0x3e734462ed6536e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510313.920068:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032800/0x3e734462ed6536e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510313.920082:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032800/0x3e734462ed6536e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510313.920115:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788510313.920118:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510313.920133:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032800/0x3e734462ed6536e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510313.920155:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73137 expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510313.920206:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032800/0x3e734462ed6536e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73137 expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510313.920214:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a82b92200) 00010000:00010000:1.0:1788510313.920217:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788510313.920314:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032800, rc 0) 00000100:00100000:1.0:1788510313.920670:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:5610:x1875388852603904:12345-192.168.201.4@tcp:101: Request processed in 719us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510313.920679:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 8 00010000:00010000:2.0:1788510314.760407:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510315.204504:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788510315.204527:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861014272:0@lo:13: 00000100:00100000:0.0:1788510315.204593:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510315.205433:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861014272 00000100:00100000:2.0:1788510315.205443:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861014272 00000100:00100000:2.0:1788510315.205506:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788510315.205516:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861014272:12345-0@lo:13: 00002000:00000024:2.0:1788510315.205548:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510315.205604:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861014272:12345-0@lo:13: Request processed in 90us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510315.205611:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788510315.205660:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd4700 x1875388861014272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510315.205689:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861014272:0@lo:13: 00000100:00080000:0.0:1788510315.206031:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788510315.780604:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510316.505154:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510316.505439:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852604032 00000100:00100000:2.0:1788510316.505449:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852604032 00000100:00100000:2.0:1788510316.505520:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:2.0:1788510316.505530:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:5663:x1875388852604032:12345-192.168.201.4@tcp:41: 00000004:00000024:2.0:1788510316.505570:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788510316.505645:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:5663:x1875388852604032:12345-192.168.201.4@tcp:41: Request processed in 108us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510316.505661:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00080000:0.0:1788510316.510752:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510316.517774:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510316.517959:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852604160 00000100:00100000:2.0:1788510316.517969:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852604160 00000100:00100000:2.0:1788510316.518039:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:2.0:1788510316.518050:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:5663:x1875388852604160:12345-192.168.201.4@tcp:13: 00002000:00000024:2.0:1788510316.518075:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788510316.518197:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510316.518311:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:5663:x1875388852604160:12345-192.168.201.4@tcp:13: Request processed in 261us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510316.518346:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:1.0:1788510316.529077:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510316.529792:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852604288 00000100:00100000:2.0:1788510316.529813:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852604288 00000100:00100000:2.0:1788510316.529896:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:2.0:1788510316.529907:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:5663:x1875388852604288:12345-192.168.201.4@tcp:13: 00002000:00000024:2.0:1788510316.529945:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510316.530013:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:5663:x1875388852604288:12345-192.168.201.4@tcp:13: Request processed in 107us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510316.530020:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00080000:0.0:1788510316.530544:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788510316.804560:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510317.252781:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861014784:0@lo:400: 00000100:00100000:1.0:1788510317.253025:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861014400:0@lo:400: 00000100:00100000:1.0:1788510317.253095:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510317.253140:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861014912:0@lo:400: 00000100:00100000:1.0:1788510317.253196:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510317.253256:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861014400 00000100:00100000:1.0:1788510317.253265:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861014400 00000100:00100000:1.0:1788510317.253309:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788510317.253317:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861014400:12345-0@lo:400: 00000100:00100000:1.0:1788510317.253367:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861014400:12345-0@lo:400: Request processed in 50us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510317.253373:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788510317.253403:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861014912 00000100:00100000:1.0:1788510317.253406:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861014912 00000100:00100000:1.0:1788510317.254288:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788510317.254302:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861014912:12345-0@lo:400: 00000100:00100000:1.0:1788510317.254369:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861014912:12345-0@lo:400: Request processed in 72us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510317.254376:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788510317.254416:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861014400:0@lo:400: 00000100:00100000:1.0:1788510317.254430:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861014912:0@lo:400: 00000100:00100000:1.0:1788510317.254477:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861014656:0@lo:400: 00000100:00100000:1.0:1788510317.254505:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510317.254529:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788510317.254535:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861014528:0@lo:400: 00000100:00100000:1.0:1788510317.254552:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510317.255696:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788510317.255755:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510317.256654:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861015040:0@lo:400: 00000100:00100000:1.0:1788510317.256692:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510317.257535:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861014656 00000100:00100000:2.0:1788510317.257546:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861014656 00000100:00100000:3.0:1788510317.258489:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861014528 00000100:00100000:3.0:1788510317.258497:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861014528 00000100:00100000:3.0:1788510317.258540:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788510317.258549:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861014528:12345-0@lo:400: 00000100:00100000:0.0:1788510317.261295:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861014784 00000100:00100000:0.0:1788510317.261312:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861014784 00000100:00100000:3.0:1788510317.263590:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861014528:12345-0@lo:400: Request processed in 5034us (9028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510317.263605:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788510317.263688:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861014528:0@lo:400: 00000100:00100000:2.0:1788510317.270250:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788510317.270268:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861014656:12345-0@lo:400: 00000100:00100000:2.0:1788510317.270374:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861014656:12345-0@lo:400: Request processed in 111us (15867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510317.270381:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788510317.270450:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861014656:0@lo:400: 00000100:00080000:0.0:1788510317.271042:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788510317.271048:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510317.271065:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861015040 00000100:00100000:0.0:1788510317.271072:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861015040 00000100:00100000:0.0:1788510317.271126:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788510317.271148:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861015040:12345-0@lo:400: 00000100:00100000:0.0:1788510317.271219:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861015040:12345-0@lo:400: Request processed in 74us (14526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510317.271241:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788510317.271277:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abaf23100 x1875388861015040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510317.271288:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861015040:0@lo:400: 00000100:00100000:0.0:1788510317.271329:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788510317.271337:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861014784:12345-0@lo:400: 00000100:00100000:0.0:1788510317.272161:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861014784:12345-0@lo:400: Request processed in 822us (16466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510317.272180:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788510317.272317:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abaf21c00 x1875388861014784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510317.272330:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861014784:0@lo:400: 00000100:00080000:2.0:1788510317.272821:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788510317.768997:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861015168:0@lo:13: 00000100:00100000:0.0:1788510317.769068:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510317.769139:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861015168 00000100:00100000:0.0:1788510317.769172:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861015168 00000100:00100000:0.0:1788510317.769239:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788510317.769250:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861015168:12345-0@lo:13: 00002000:00000024:0.0:1788510317.769276:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510317.769317:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861015168:12345-0@lo:13: Request processed in 69us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510317.769324:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788510317.769382:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abaf21c00 x1875388861015168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510317.769402:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861015168:0@lo:13: 00010000:00010000:0.0:1788510317.829054:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788510317.873763:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000001:00100000:1.0:1788510318.377693:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000001:00100000:1.0:1788510318.382020:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00010000:00010000:2.0:1788510318.852621:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510319.224375:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510319.224422:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510319.224484:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510319.224513:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510319.224815:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852604672 00000100:00100000:0.0:1788510319.224825:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852604672 00000100:00100000:3.0:1788510319.224847:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852604416 00000100:00100000:3.0:1788510319.224851:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852604416 00000100:00100000:0.0:1788510319.224886:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852604800 00000100:00100000:0.0:1788510319.224889:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852604800 00000100:00100000:3.0:1788510319.224891:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 129 00000100:00100000:3.0:1788510319.224900:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2342:x1875388852604416:12345-192.168.201.4@tcp:400: 00000100:00100000:0.0:1788510319.224907:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:0.0:1788510319.224913:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852604672:12345-192.168.201.4@tcp:400: 00000100:00100000:3.0:1788510319.224965:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2342:x1875388852604416:12345-192.168.201.4@tcp:400: Request processed in 65us (600us total) trans 0 rc 0/0 00000100:00080000:2.0:1788510319.224965:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788510319.224970:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788510319.224972:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 129 00000100:00100000:3.0:1788510319.225003:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852604544 00000100:00100000:3.0:1788510319.225007:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852604544 00000100:00100000:3.0:1788510319.225058:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 25 00000100:00100000:3.0:1788510319.225065:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2342:x1875388852604544:12345-192.168.201.4@tcp:400: 00000100:00080000:2.0:1788510319.225072:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510319.231023:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852604672:12345-192.168.201.4@tcp:400: Request processed in 6096us (6586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510319.231040:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:0.0:1788510319.231076:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:0.0:1788510319.231089:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852604800:12345-192.168.201.4@tcp:400: 00000100:00100000:0.0:1788510319.231153:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852604800:12345-192.168.201.4@tcp:400: Request processed in 69us (6639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510319.231159:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:3.0:1788510319.232931:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2342:x1875388852604544:12345-192.168.201.4@tcp:400: Request processed in 7858us (8437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510319.232952:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 25 00000001:02000400:3.0:1788510319.416044:0:8275:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788510319.877895:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510320.325891:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788510320.325924:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861015296:0@lo:13: 00000100:00100000:1.0:1788510320.326026:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510320.326372:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861015296 00000100:00100000:2.0:1788510320.326382:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861015296 00000100:00100000:2.0:1788510320.326459:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788510320.326470:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861015296:12345-0@lo:13: 00002000:00000024:2.0:1788510320.326508:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510320.326562:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861015296:12345-0@lo:13: Request processed in 94us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510320.326569:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788510320.326612:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd4000 x1875388861015296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510320.326632:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861015296:0@lo:13: 00000100:00080000:0.0:1788510320.326820:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788510320.911030:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510321.927541:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510322.376284:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861015808:0@lo:400: 00000100:00100000:0.0:1788510322.376425:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861015424:0@lo:400: 00000100:00100000:0.0:1788510322.376481:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510322.376529:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861015936:0@lo:400: 00000100:00100000:0.0:1788510322.376557:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510322.376607:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861015680:0@lo:400: 00000100:00100000:0.0:1788510322.376632:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510322.376652:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788510322.376657:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861015552:0@lo:400: 00000100:00100000:0.0:1788510322.376679:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510322.376697:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861016064:0@lo:400: 00000100:00100000:0.0:1788510322.376737:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510322.376766:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861015424 00000100:00100000:0.0:1788510322.376773:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861015424 00000100:00100000:0.0:1788510322.376821:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788510322.376831:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861015424:12345-0@lo:400: 00000100:00100000:0.0:1788510322.376881:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861015424:12345-0@lo:400: Request processed in 50us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510322.376890:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788510322.376929:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861015936 00000100:00100000:0.0:1788510322.376932:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861015936 00000100:00100000:0.0:1788510322.376962:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861015680 00000100:00100000:0.0:1788510322.376965:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861015680 00000100:00100000:0.0:1788510322.376976:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861015552 00000100:00100000:0.0:1788510322.376978:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861015552 00000100:00100000:0.0:1788510322.376988:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788510322.376993:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861015936:12345-0@lo:400: 00000100:00100000:0.0:1788510322.377027:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861015936:12345-0@lo:400: Request processed in 34us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510322.377034:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788510322.377045:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788510322.377051:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861015680:12345-0@lo:400: 00000100:00100000:0.0:1788510322.377093:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861015680:12345-0@lo:400: Request processed in 30us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510322.377108:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788510322.377121:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788510322.377127:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861015552:12345-0@lo:400: 00000100:00100000:0.0:1788510322.377156:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861015552:12345-0@lo:400: Request processed in 30us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510322.377163:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788510322.377185:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861016064 00000100:00100000:0.0:1788510322.377189:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861016064 00000100:00100000:0.0:1788510322.377220:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788510322.377251:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861016064:12345-0@lo:400: 00000100:00100000:0.0:1788510322.377283:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861016064:12345-0@lo:400: Request processed in 33us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510322.377288:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788510322.377309:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788510322.377433:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510322.377473:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861015808 00000100:00100000:2.0:1788510322.377478:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861015808 00000100:00100000:2.0:1788510322.377504:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788510322.377510:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861015808:12345-0@lo:400: 00000100:00100000:2.0:1788510322.377543:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861015808:12345-0@lo:400: Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510322.377548:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788510322.377581:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd4a80 x1875388861015808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510322.377595:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861015808:0@lo:400: 00000100:00080000:0.0:1788510322.377640:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788510322.377643:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510322.377674:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861015552:0@lo:400: 00010000:00080000:0.0:1788510322.377686:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd6300 x1875388861016064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510322.377694:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861016064:0@lo:400: 00000100:00100000:0.0:1788510322.377705:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861015680:0@lo:400: 00000100:00100000:0.0:1788510322.377733:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861015424:0@lo:400: 00000100:00100000:0.0:1788510322.377744:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861015936:0@lo:400: 00000100:00100000:0.0:1788510322.885617:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861016192:0@lo:13: 00000100:00100000:0.0:1788510322.885700:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510322.886143:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861016192 00000100:00100000:3.0:1788510322.886152:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861016192 00000100:00100000:3.0:1788510322.886204:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788510322.886214:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861016192:12345-0@lo:13: 00002000:00000024:3.0:1788510322.886273:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510322.886335:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861016192:12345-0@lo:13: Request processed in 122us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510322.886342:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788510322.886384:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a8578ca80 x1875388861016192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510322.886480:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861016192:0@lo:13: 00010000:00010000:0.0:1788510322.948644:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510323.974141:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788510324.291095:0:8424:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1ace67f0 20000000:00000080:2.0:1788510324.291192:0:8424:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff929aae979c00 uarg=0000000000000000 20000000:01000000:2.0:1788510324.291397:0:8424:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788510324.291400:0:8424:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788510324.291403:0:8424:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788510324.291409:0:8424:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788510324.291414:0:8424:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788510324.291429:0:8424:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788510324.291432:0:8424:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788510324.291776:0:8424:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788510324.291780:0:8424:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788510324.299703:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788510324.300383:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788510324.300453:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788510324.300496:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788510324.300509:0:8424:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788510324.300511:0:8424:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788510324.301417:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788510324.301766:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788510324.301812:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788510324.301865:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788510324.301878:0:8424:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788510324.301880:0:8424:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788510324.302643:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788510324.303194:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788510324.303297:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788510324.303336:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788510324.303350:0:8424:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788510324.303353:0:8424:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788510324.304742:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788510324.315958:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788510324.316016:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788510324.316065:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1788510324.316086:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788510324.316104:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316122:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a80030800/0x3e734462ed65272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6526b expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316130:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a81532a00/0x3e734462ed6529c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65295 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316138:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a81532e00/0x3e734462ed652c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed652bf expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316145:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a81532800/0x3e734462ed652d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed652cd expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316152:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a81533200/0x3e734462ed652e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed652db expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316158:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a83033400/0x3e734462ed652fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed652f7 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316164:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a83033000/0x3e734462ed65328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65321 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316184:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a83032c00/0x3e734462ed65336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730d5 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316192:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a83033800/0x3e734462ed6533d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730dc expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316200:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316362:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a83033800/0x3e734462ed6533d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730dc expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316378:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a83033800/0x3e734462ed6533d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730dc expref: 9 pid: 5816 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.316391:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016320:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510324.316539:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a83032c00/0x3e734462ed65336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730d5 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316548:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a83032c00/0x3e734462ed65336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730d5 expref: 9 pid: 5815 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.316558:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016448:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510324.316591:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a83033000/0x3e734462ed65328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed65321 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316599:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a83033000/0x3e734462ed65328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed65321 expref: 18 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.316619:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016576:0@lo:104: 00000100:00100000:0.0:1788510324.316660:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788510324.316705:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a83033400/0x3e734462ed652fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed652f7 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316712:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a83033400/0x3e734462ed652fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed652f7 expref: 18 pid: 5815 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.316720:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016704:0@lo:104: 00000100:00100000:0.0:1788510324.316741:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788510324.316772:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a81533200/0x3e734462ed652e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed652db expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316779:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a81533200/0x3e734462ed652e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed652db expref: 18 pid: 5814 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.316787:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016832:0@lo:104: 00010000:00010000:0.0:1788510324.316810:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a81532800/0x3e734462ed652d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed652cd expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316817:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a81532800/0x3e734462ed652d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed652cd expref: 18 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.316824:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016960:0@lo:104: 00010000:00010000:0.0:1788510324.316846:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a81532e00/0x3e734462ed652c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed652bf expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316853:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a81532e00/0x3e734462ed652c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed652bf expref: 18 pid: 5815 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.316869:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861017088:0@lo:104: 00010000:00010000:0.0:1788510324.316897:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a81532a00/0x3e734462ed6529c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed65295 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316905:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a81532a00/0x3e734462ed6529c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed65295 expref: 18 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.316912:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861017216:0@lo:104: 00010000:00010000:0.0:1788510324.316935:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a80030800/0x3e734462ed65272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6526b expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.316941:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a80030800/0x3e734462ed65272 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6526b expref: 18 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.316949:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861017344:0@lo:104: 00000100:00100000:0.0:1788510324.316967:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510324.318249:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788510324.318291:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.318329:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.318338:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.318348:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.318357:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.318366:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861016576 00000100:00100000:3.0:1788510324.318373:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861016576 00000100:00100000:3.0:1788510324.318413:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861016704 00000100:00100000:3.0:1788510324.318416:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861016704 00000100:00100000:3.0:1788510324.318426:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861016832 00000100:00100000:3.0:1788510324.318428:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861016832 00000100:00100000:3.0:1788510324.318437:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861016960 00000100:00100000:3.0:1788510324.318439:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861016960 00000100:00100000:3.0:1788510324.318448:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861017088 00000100:00100000:3.0:1788510324.318450:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861017088 00000100:00100000:3.0:1788510324.318475:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861017216 00000100:00100000:3.0:1788510324.318477:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861017216 00000100:00100000:3.0:1788510324.318484:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861017344 00000100:00100000:3.0:1788510324.318486:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861017344 00000100:00100000:3.0:1788510324.318498:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788510324.318507:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+9:8424:x1875388861016576:12345-0@lo:104: 00010000:00010000:3.0:1788510324.318523:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.318586:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788510324.318592:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+9:8424:x1875388861016576:12345-0@lo:104: Request processed in 88us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.318599:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788510324.318615:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788510324.318620:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb18cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+8:8424:x1875388861016704:12345-0@lo:104: 00010000:00010000:3.0:1788510324.318627:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.318657:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788510324.318661:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb18cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+8:8424:x1875388861016704:12345-0@lo:104: Request processed in 42us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.318666:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788510324.318695:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788510324.318700:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+7:8424:x1875388861016832:12345-0@lo:104: 00010000:00010000:3.0:1788510324.318707:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.318731:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788510324.318741:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+7:8424:x1875388861016832:12345-0@lo:104: Request processed in 42us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.318747:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788510324.318758:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788510324.318764:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+6:8424:x1875388861016960:12345-0@lo:104: 00010000:00010000:3.0:1788510324.318772:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.318798:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788510324.318803:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+6:8424:x1875388861016960:12345-0@lo:104: Request processed in 40us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.318809:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788510324.318820:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788510324.318825:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+5:8424:x1875388861017088:12345-0@lo:104: 00010000:00010000:3.0:1788510324.318831:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.318854:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788510324.318858:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+5:8424:x1875388861017088:12345-0@lo:104: Request processed in 35us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.318863:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788510324.318873:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788510324.318877:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+4:8424:x1875388861017216:12345-0@lo:104: 00010000:00010000:3.0:1788510324.318883:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.318904:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788510324.318914:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+4:8424:x1875388861017216:12345-0@lo:104: Request processed in 36us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.318919:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788510324.318930:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788510324.318935:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+3:8424:x1875388861017344:12345-0@lo:104: 00010000:00010000:3.0:1788510324.318942:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.318966:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788510324.318970:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+3:8424:x1875388861017344:12345-0@lo:104: Request processed in 36us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.318975:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788510324.318993:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788510324.318999:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319005:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510324.319009:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319017:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510324.319023:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510324.319029:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788510324.319079:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319096:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510324.319117:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319124:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65328 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319139:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788510324.319142:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319147:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033600 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510324.319150:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319156:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510324.319161:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510324.319166:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788510324.319178:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319182:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510324.319187:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319193:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a83033600/0x3e734462ed652f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319205:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788510324.319208:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319213:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81533c00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510324.319216:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319246:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510324.319252:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510324.319257:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788510324.319269:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319274:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510324.319289:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319295:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81533c00/0x3e734462ed652db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319304:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788510324.319307:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319322:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80031e00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510324.319325:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319331:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510324.319336:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510324.319341:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788510324.319354:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319360:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510324.319365:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319371:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed652cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319380:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788510324.319382:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319387:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510324.319390:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319405:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510324.319411:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510324.319417:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788510324.319429:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319434:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510324.319438:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319444:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a83032000/0x3e734462ed652bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed652c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319453:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788510324.319455:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319461:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd600 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510324.319464:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319470:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510324.319476:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510324.319486:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788510324.319499:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319504:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510324.319508:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319514:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed65295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6529c expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319524:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510324.319527:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319532:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd400 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510324.319535:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319541:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510324.319547:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510324.319552:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788510324.319562:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319568:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510324.319578:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319584:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed6526b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65272 expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.319597:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510324.319599:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510324.319601:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510324.319609:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510324.319624:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861017472:0@lo:103: 00000100:00100000:3.0:1788510324.319662:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.319696:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861017984:0@lo:103: 00000100:00100000:3.0:1788510324.319714:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.319734:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788510324.319740:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861017600:0@lo:103: 00000100:00100000:3.0:1788510324.319759:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.319776:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861018112:0@lo:103: 00000100:00100000:3.0:1788510324.319793:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.319814:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861017728:0@lo:103: 00000100:00100000:3.0:1788510324.319834:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.319844:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861018240:0@lo:103: 00000100:00100000:3.0:1788510324.319877:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.319891:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788510324.319895:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861017856:0@lo:103: 00000100:00100000:3.0:1788510324.319917:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510324.319941:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861017472 00000100:00100000:3.0:1788510324.319951:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861017472 00010000:00010000:3.0:1788510324.319975:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a83033000/0x3e734462ed65328 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65321 expref: 19 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510324.319994:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861017984 00000100:00100000:3.0:1788510324.319997:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861017984 00010000:00010000:3.0:1788510324.320007:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a81532e00/0x3e734462ed652c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed652bf expref: 20 pid: 5815 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510324.320017:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861017600 00000100:00100000:3.0:1788510324.320019:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861017600 00010000:00010000:3.0:1788510324.320028:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a83033400/0x3e734462ed652fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed652f7 expref: 21 pid: 5815 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510324.320037:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861018112 00000100:00100000:3.0:1788510324.320039:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861018112 00010000:00010000:3.0:1788510324.320064:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a81532a00/0x3e734462ed6529c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65295 expref: 22 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510324.320074:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861017728 00000100:00100000:3.0:1788510324.320077:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861017728 00010000:00010000:3.0:1788510324.320087:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a81533200/0x3e734462ed652e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed652db expref: 23 pid: 5814 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510324.320096:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861018240 00000100:00100000:3.0:1788510324.320098:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861018240 00010000:00010000:3.0:1788510324.320107:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a80030800/0x3e734462ed65272 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6526b expref: 24 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510324.320116:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861017856 00000100:00100000:3.0:1788510324.320118:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861017856 00010000:00010000:3.0:1788510324.320127:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a81532800/0x3e734462ed652d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed652cd expref: 25 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510324.320152:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788510324.320160:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+25:3288:x1875388861017472:12345-0@lo:103: 00010000:00010000:3.0:1788510324.320172:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510324.320178:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a83033000/0x3e734462ed65328 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65321 expref: 25 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320188:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a83033000/0x3e734462ed65328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed65321 expref: 25 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320205:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510324.320258:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+25:3288:x1875388861017472:12345-0@lo:103: Request processed in 99us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.320265:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788510324.320280:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788510324.320285:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+24:3288:x1875388861017984:12345-0@lo:103: 00010000:00010000:3.0:1788510324.320293:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510324.320297:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a81532e00/0x3e734462ed652c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed652bf expref: 24 pid: 5815 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320305:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a81532e00/0x3e734462ed652c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed652bf expref: 24 pid: 5815 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320314:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510324.320333:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+24:3288:x1875388861017984:12345-0@lo:103: Request processed in 48us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.320339:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788510324.320351:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788510324.320364:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+23:3288:x1875388861017600:12345-0@lo:103: 00010000:00010000:3.0:1788510324.320371:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510324.320375:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a83033400/0x3e734462ed652fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed652f7 expref: 23 pid: 5815 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320383:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a83033400/0x3e734462ed652fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed652f7 expref: 23 pid: 5815 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320392:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510324.320412:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+23:3288:x1875388861017600:12345-0@lo:103: Request processed in 50us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.320418:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788510324.320430:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788510324.320435:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+22:3288:x1875388861018112:12345-0@lo:103: 00010000:00010000:3.0:1788510324.320442:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510324.320446:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a81532a00/0x3e734462ed6529c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65295 expref: 22 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320454:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a81532a00/0x3e734462ed6529c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed65295 expref: 22 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320462:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510324.320482:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+22:3288:x1875388861018112:12345-0@lo:103: Request processed in 47us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.320487:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788510324.320498:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788510324.320503:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+21:3290:x1875388861017728:12345-0@lo:103: 00010000:00010000:3.0:1788510324.320510:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510324.320518:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a81533200/0x3e734462ed652e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed652db expref: 21 pid: 5814 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320526:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a81533200/0x3e734462ed652e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed652db expref: 21 pid: 5814 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320535:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510324.320561:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+21:3290:x1875388861017728:12345-0@lo:103: Request processed in 58us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.320567:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788510324.320579:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788510324.320584:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+20:3290:x1875388861018240:12345-0@lo:103: 00010000:00010000:3.0:1788510324.320602:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510324.320608:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a80030800/0x3e734462ed65272 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6526b expref: 20 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320615:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a80030800/0x3e734462ed65272 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6526b expref: 20 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320625:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510324.320647:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+20:3290:x1875388861018240:12345-0@lo:103: Request processed in 63us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.320653:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788510324.320666:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788510324.320671:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87751c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861017856:12345-0@lo:103: 00010000:00010000:3.0:1788510324.320678:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510324.320682:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a81532800/0x3e734462ed652d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed652cd expref: 19 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320700:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a81532800/0x3e734462ed652d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed652cd expref: 19 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.320710:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510324.320733:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87751c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861017856:12345-0@lo:103: Request processed in 63us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.320738:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788510324.320796:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861017856:0@lo:103: 00000100:00100000:3.0:1788510324.320806:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861017728:0@lo:103: 00000100:00100000:3.0:1788510324.320813:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861018240:0@lo:103: 00000100:00100000:3.0:1788510324.320839:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861017600:0@lo:103: 00000100:00100000:3.0:1788510324.320846:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861018112:0@lo:103: 00000100:00100000:3.0:1788510324.320853:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861017472:0@lo:103: 00000100:00100000:3.0:1788510324.320859:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861017984:0@lo:103: 00010000:00010000:0.0:1788510324.320999:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83033000/0x3e734462ed65328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed65321 expref: 18 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.321010:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016576:0@lo:104: 00010000:00010000:0.0:1788510324.321020:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83033400/0x3e734462ed652fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed652f7 expref: 17 pid: 5815 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.321027:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016704:0@lo:104: 00010000:00010000:0.0:1788510324.321036:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81533200/0x3e734462ed652e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed652db expref: 16 pid: 5814 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.321056:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016832:0@lo:104: 00010000:00010000:0.0:1788510324.321076:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81532800/0x3e734462ed652d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed652cd expref: 15 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.321086:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016960:0@lo:104: 00010000:00010000:0.0:1788510324.321095:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81532e00/0x3e734462ed652c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed652bf expref: 14 pid: 5815 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.321102:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861017088:0@lo:104: 00010000:00010000:0.0:1788510324.321111:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81532a00/0x3e734462ed6529c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed65295 expref: 13 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.321117:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861017216:0@lo:104: 00010000:00010000:0.0:1788510324.321125:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80030800/0x3e734462ed65272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6526b expref: 12 pid: 5816 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.321133:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861017344:0@lo:104: 00000100:00100000:3.0:1788510324.331382:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510324.331475:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510324.331599:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510324.331634:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510324.331672:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852604928 00000100:00100000:3.0:1788510324.331680:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852604928 00000100:00100000:3.0:1788510324.331732:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 131 00000100:00100000:3.0:1788510324.331742:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2341:x1875388852604928:12345-192.168.201.4@tcp:400: 00000100:00100000:3.0:1788510324.331810:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2341:x1875388852604928:12345-192.168.201.4@tcp:400: Request processed in 68us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.331833:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 131 00000100:00100000:3.0:1788510324.331878:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852605312 00000100:00100000:3.0:1788510324.331882:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852605312 00000100:00100000:3.0:1788510324.331917:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852605184 00000100:00100000:3.0:1788510324.331920:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852605184 00000100:00100000:3.0:1788510324.331940:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:3.0:1788510324.331946:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852605312:12345-192.168.201.4@tcp:400: 00000100:00100000:3.0:1788510324.331975:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852605312:12345-192.168.201.4@tcp:400: Request processed in 29us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.331982:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:3.0:1788510324.331993:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:3.0:1788510324.331999:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852605184:12345-192.168.201.4@tcp:400: 00000100:00100000:3.0:1788510324.332022:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852605184:12345-192.168.201.4@tcp:400: Request processed in 23us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510324.332028:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00080000:3.0:1788510324.332043:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788510324.332083:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788510324.332398:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852605056 00000100:00100000:0.0:1788510324.332403:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852605056 00000100:00100000:0.0:1788510324.332442:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 29 00000100:00100000:0.0:1788510324.332449:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852605056:12345-192.168.201.4@tcp:400: 00000100:00100000:0.0:1788510324.332482:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852605056:12345-192.168.201.4@tcp:400: Request processed in 33us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510324.332488:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 29 00000100:00080000:3.0:1788510324.332698:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510324.344917:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510324.344954:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510324.345032:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852605440 00000100:00100000:1.0:1788510324.345042:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852605440 00010000:00010000:1.0:1788510324.345091:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a83033800/0x3e734462ed6533d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730dc expref: 10 pid: 5816 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510324.345126:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852605568 00000100:00100000:1.0:1788510324.345130:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852605568 00010000:00010000:1.0:1788510324.345157:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a83032c00/0x3e734462ed65336 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730d5 expref: 11 pid: 5815 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510324.345173:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:1.0:1788510324.345181:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:2342:x1875388852605440:12345-192.168.201.4@tcp:103: 00010000:00010000:1.0:1788510324.345197:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510324.345202:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a83033800/0x3e734462ed6533d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730dc expref: 11 pid: 5816 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345213:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a83033800/0x3e734462ed6533d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730dc expref: 11 pid: 5816 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345255:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510324.345307:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:2342:x1875388852605440:12345-192.168.201.4@tcp:103: Request processed in 126us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510324.345314:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:1.0:1788510324.345331:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:1.0:1788510324.345336:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2342:x1875388852605568:12345-192.168.201.4@tcp:103: 00010000:00010000:1.0:1788510324.345344:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510324.345348:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a83032c00/0x3e734462ed65336 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730d5 expref: 10 pid: 5815 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345356:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a83032c00/0x3e734462ed65336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730d5 expref: 10 pid: 5815 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345366:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345375:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345395:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345402:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345409:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345417:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345423:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80031200 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510324.345427:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345435:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345443:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510324.345453:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510324.345473:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2342:x1875388852605568:12345-192.168.201.4@tcp:103: Request processed in 136us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510324.345479:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 20 00010000:00010000:0.0:1788510324.345651:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83033800/0x3e734462ed6533d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730dc expref: 9 pid: 5816 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.345664:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016320:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510324.345674:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83032c00/0x3e734462ed65336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc730d5 expref: 8 pid: 5815 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510324.345691:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8424:1875388861016448:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510324.345728:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.345736:0:8424:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.345741:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510324.345747:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80031200/0x3e734462ed65375 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510324.996623:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510325.444743:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861018368:0@lo:13: 00000100:00100000:3.0:1788510325.444853:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510325.445209:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861018368 00000100:00100000:2.0:1788510325.445218:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861018368 00000100:00100000:2.0:1788510325.445316:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788510325.445346:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861018368:12345-0@lo:13: 00002000:00000024:2.0:1788510325.445405:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510325.445508:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861018368:12345-0@lo:13: Request processed in 180us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510325.445519:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788510325.445617:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd4a80 x1875388861018368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510325.445666:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861018368:0@lo:13: 00000100:00080000:3.0:1788510325.447549:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1788510325.510153:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788510325.510162:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff929a85c6b800 from 39 10000000:01000000:0.0:1788510325.510169:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788510325.510249:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.510262:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.510273:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510325.510297:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861018496:0@lo:101: 00000100:00100000:0.0:1788510325.510386:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510325.510499:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.517237:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861018496 00000100:00100000:3.0:1788510325.517549:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861018496 00000100:00100000:3.0:1788510325.517776:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788510325.517789:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+12:5818:x1875388861018496:12345-0@lo:101: 00010000:00010000:3.0:1788510325.517809:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510325.517830:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81533c00/0x3e734462ed65383 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6537c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.517862:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81533c00/0x3e734462ed65383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6537c expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.517873:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81533c00/0x3e734462ed65383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6537c expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.517882:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81533c00, rc 0) 00000100:00100000:3.0:1788510325.517976:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388861018496:12345-0@lo:101: Request processed in 190us (7589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.517983:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788510325.518087:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861018496:0@lo:101: 00010000:00010000:0.0:1788510325.518116:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.518126:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510325.518194:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861018624:0@lo:501: 00000100:00100000:0.0:1788510325.518274:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510325.525555:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510325.527056:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861018624 00000100:00100000:2.0:1788510325.527072:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861018624 00000100:00100000:2.0:1788510325.527143:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788510325.527154:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388861018624:12345-0@lo:501: 00000100:00100000:2.0:1788510325.527950:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388861018624:12345-0@lo:501: Request processed in 796us (9673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510325.527959:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788510325.541073:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861018624:0@lo:501: 00000100:00100000:0.0:1788510325.541141:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861018752:0@lo:503: 00000100:00100000:0.0:1788510325.541263:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510325.541309:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.541571:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861018752 00000100:00100000:3.0:1788510325.541578:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861018752 00000100:00100000:3.0:1788510325.541625:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788510325.541633:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388861018752:12345-0@lo:503: 00000100:00100000:3.0:1788510325.541851:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388861018752:12345-0@lo:503: Request processed in 217us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.541859:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788510325.542008:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861018752:0@lo:503: 00000100:00100000:1.0:1788510325.547040:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8440:1875388861018880:0@lo:502: 00000100:00100000:1.0:1788510325.547139:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510325.547196:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c92480 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.547479:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861018880 00000100:00100000:3.0:1788510325.547489:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861018880 00000100:00100000:3.0:1788510325.547546:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788510325.547556:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:8440:x1875388861018880:12345-0@lo:502: 00000100:00100000:3.0:1788510325.549075:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:8440:x1875388861018880:12345-0@lo:502: Request processed in 1514us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.549097:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788510325.551392:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8440:1875388861018880:0@lo:502: 00000100:00100000:1.0:1788510325.551503:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8440:1875388861019008:0@lo:502: 00000100:00100000:1.0:1788510325.551579:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510325.551630:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c92480 going to sleep for 11 seconds 00000100:00100000:2.0:1788510325.552833:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861019008 00000100:00100000:2.0:1788510325.552847:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861019008 00000100:00100000:2.0:1788510325.552917:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788510325.552927:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:8440:x1875388861019008:12345-0@lo:502: 00000100:00100000:2.0:1788510325.553290:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+13:8440:x1875388861019008:12345-0@lo:502: Request processed in 363us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510325.553298:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788510325.558452:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8440:1875388861019008:0@lo:502: 00000040:00080000:1.0:1788510325.558543:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788510325.559723:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788510325.559772:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788510325.559792:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.559809:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510325.559826:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788510325.559830:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788510325.559834:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788510325.559897:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.559936:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.559952:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510325.559979:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861019136:0@lo:101: 00000100:00100000:0.0:1788510325.560100:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510325.560196:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.562936:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861019136 00000100:00100000:3.0:1788510325.562955:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861019136 00000100:00100000:3.0:1788510325.563016:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788510325.563035:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+13:5818:x1875388861019136:12345-0@lo:101: 00010000:00010000:3.0:1788510325.563055:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510325.563073:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81532c00/0x3e734462ed65391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6538a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.563105:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81532c00/0x3e734462ed65391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6538a expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.563117:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81532c00/0x3e734462ed65391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6538a expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.563127:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81532c00, rc 0) 00000100:00100000:3.0:1788510325.563267:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861019136:12345-0@lo:101: Request processed in 243us (3171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.563274:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788510325.563975:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861019136:0@lo:101: 00010000:00010000:0.0:1788510325.563999:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.564010:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510325.564092:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861019264:0@lo:501: 00000100:00100000:0.0:1788510325.564133:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510325.564174:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.568705:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861019264 00000100:00100000:3.0:1788510325.568723:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861019264 00000100:00100000:3.0:1788510325.568796:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788510325.568807:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861019264:12345-0@lo:501: 00000100:00100000:3.0:1788510325.571830:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861019264:12345-0@lo:501: Request processed in 3011us (7682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.571849:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788510325.572185:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861019264:0@lo:501: 00000100:00100000:0.0:1788510325.572312:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861019392:0@lo:503: 00000100:00100000:0.0:1788510325.573477:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510325.573531:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510325.573685:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861019392 00000100:00100000:2.0:1788510325.573694:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861019392 00000100:00100000:2.0:1788510325.573744:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788510325.573753:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861019392:12345-0@lo:503: 00000100:00100000:2.0:1788510325.573964:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861019392:12345-0@lo:503: Request processed in 211us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510325.573975:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788510325.574141:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861019392:0@lo:503: 00000100:00100000:3.0:1788510325.586979:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8441:1875388861019520:0@lo:502: 00000100:00100000:3.0:1788510325.587090:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510325.587138:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cda900 going to sleep for 11 seconds 00000100:00100000:0.0:1788510325.587209:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861019520 00000100:00100000:0.0:1788510325.587240:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861019520 00000100:00100000:0.0:1788510325.587298:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788510325.587310:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+14:8441:x1875388861019520:12345-0@lo:502: 00000100:00100000:0.0:1788510325.587963:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+14:8441:x1875388861019520:12345-0@lo:502: Request processed in 654us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510325.587971:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788510325.588263:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8441:1875388861019520:0@lo:502: 00000020:01000000:3.0:1788510325.588297:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788510325.588306:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510325.588309:0:8441:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788510325.588314:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788510325.588356:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8441:1875388861019648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510325.588546:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510325.588581:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cda900 going to sleep for 11 seconds 00000100:00100000:0.0:1788510325.588728:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861019648 00000100:00100000:0.0:1788510325.588734:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861019648 00000100:00100000:0.0:1788510325.588776:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788510325.588784:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:8441:x1875388861019648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510325.588951:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:8441:x1875388861019648:12345-0@lo:502:llog_process_th.0 Request processed in 167us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510325.588958:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788510325.589056:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8441:1875388861019648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788510325.589078:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510325.589083:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510325.589085:0:8441:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788510325.589089:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788510325.589742:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788510325.589762:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788510325.589772:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.589783:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510325.589792:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788510325.589795:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff929ab4b11000 from 39 10000000:01000000:0.0:1788510325.589798:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788510325.589829:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.589836:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.589859:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510325.589876:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861019776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788510325.589915:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510325.589950:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.590138:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861019776 00000100:00100000:3.0:1788510325.590144:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861019776 00000100:00100000:3.0:1788510325.590183:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788510325.590191:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+14:5818:x1875388861019776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788510325.590215:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510325.590248:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81533800/0x3e734462ed6539f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65398 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.590268:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81533800/0x3e734462ed6539f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65398 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.590289:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81533800/0x3e734462ed6539f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65398 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.590298:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81533800, rc 0) 00000100:00100000:3.0:1788510325.590515:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861019776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 324us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.590522:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788510325.590773:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861019776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510325.590788:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.590797:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510325.590852:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861019904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510325.590879:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510325.590907:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.594433:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861019904 00000100:00100000:3.0:1788510325.594448:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861019904 00000100:00100000:3.0:1788510325.594528:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788510325.594539:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861019904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510325.594909:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861019904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (4027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.594916:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788510325.596506:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861019904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510325.596592:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861020032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510325.596660:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510325.596705:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c92600 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.598098:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861020032 00000100:00100000:3.0:1788510325.598111:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861020032 00000100:00100000:3.0:1788510325.598186:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788510325.598205:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861020032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788510325.598796:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861020032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 598us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.598804:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788510325.599069:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861020032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510325.600307:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8442:1875388861020160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510325.600376:0:8442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510325.600419:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c92480 going to sleep for 11 seconds 00000100:00100000:2.0:1788510325.600476:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861020160 00000100:00100000:2.0:1788510325.600482:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861020160 00000100:00100000:2.0:1788510325.600530:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788510325.600546:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:8442:x1875388861020160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510325.600809:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+15:8442:x1875388861020160:12345-0@lo:502:llog_process_th.0 Request processed in 262us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510325.600817:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788510325.601221:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8442:1875388861020160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510325.607671:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8442:1875388861020288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510325.607799:0:8442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510325.607849:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.608285:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861020288 00000100:00100000:3.0:1788510325.608294:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861020288 00000100:00100000:3.0:1788510325.608351:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788510325.608361:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+15:8442:x1875388861020288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510325.608645:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+15:8442:x1875388861020288:12345-0@lo:502:llog_process_th.0 Request processed in 285us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.608654:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788510325.609184:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8442:1875388861020288:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788510325.609218:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788510325.609428:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788510325.609448:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788510325.609459:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.609471:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510325.609480:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788510325.609483:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788510325.609486:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788510325.609521:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.609529:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.609538:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510325.609560:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861020416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788510325.609606:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510325.609641:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7d9cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.609782:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861020416 00000100:00100000:3.0:1788510325.609791:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861020416 00000100:00100000:3.0:1788510325.609845:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788510325.609853:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+15:5818:x1875388861020416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788510325.609865:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510325.609886:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81532a00/0x3e734462ed653ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed653a6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.609907:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81532a00/0x3e734462ed653ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed653a6 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.609918:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81532a00/0x3e734462ed653ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed653a6 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510325.609926:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81532a00, rc 0) 00000100:00100000:3.0:1788510325.609963:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861020416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.609968:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788510325.610207:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861020416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510325.610258:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.610269:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510325.610318:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861020544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788510325.610348:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510325.610365:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7d9cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510325.610377:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861020544 00000100:00100000:2.0:1788510325.610381:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861020544 00000100:00100000:2.0:1788510325.610408:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788510325.610414:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861020544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788510325.610646:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861020544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510325.610653:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788510325.610683:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861020544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788510325.610709:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861020672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510325.610744:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510325.610758:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7d9cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510325.610769:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861020672 00000100:00100000:2.0:1788510325.610772:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861020672 00000100:00100000:2.0:1788510325.612144:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788510325.612170:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861020672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510325.612432:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861020672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510325.612542:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861020672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510325.616718:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8443:1875388861020800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510325.616847:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510325.616902:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c92900 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.616960:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861020800 00000100:00100000:3.0:1788510325.616969:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861020800 00000100:00100000:2.0:1788510325.633535:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788510325.640120:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788510325.640144:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:8443:x1875388861020800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510325.640469:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:8443:x1875388861020800:12345-0@lo:502:llog_process_th.0 Request processed in 335us (23620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.640477:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788510325.640582:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8443:1875388861020800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788510325.640618:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510325.640628:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510325.640632:0:8443:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788510325.640638:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788510325.640671:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8443:1875388861020928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510325.640713:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510325.658992:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c92900 going to sleep for 11 seconds 00000100:00100000:2.0:1788510325.665818:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861020928 00000100:00100000:2.0:1788510325.665838:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861020928 00000100:00100000:2.0:1788510325.665922:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788510325.665936:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+16:8443:x1875388861020928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510325.666934:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+16:8443:x1875388861020928:12345-0@lo:502:llog_process_th.0 Request processed in 995us (26214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510325.666949:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788510325.668778:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8443:1875388861020928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788510325.668845:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510325.668858:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510325.668860:0:8443:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788510325.668865:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788510325.669256:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788510325.669281:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788510325.669292:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.669302:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510325.669313:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788510325.669316:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff929a82ae6000 from 39 10000000:01000000:2.0:1788510325.669318:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788510325.669363:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.669371:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.669381:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510325.669408:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788510325.669483:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510325.669604:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8560bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510325.669779:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861021056 00000100:00100000:1.0:1788510325.669787:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861021056 00000100:00100000:1.0:1788510325.669838:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788510325.669847:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861021056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788510325.669860:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510325.669874:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a83032c00/0x3e734462ed653bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed653b4 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510325.669898:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83032c00/0x3e734462ed653bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed653b4 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510325.669910:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a83032c00/0x3e734462ed653bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed653b4 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510325.669919:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032c00, rc 0) 00000100:00100000:1.0:1788510325.669968:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861021056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510325.669976:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788510325.670278:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510325.670294:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.670303:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510325.670364:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510325.670877:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510325.670912:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8560bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510325.671948:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861021184 00000100:00100000:1.0:1788510325.671958:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861021184 00000100:00100000:1.0:1788510325.672013:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788510325.672171:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861021184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510325.672486:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861021184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 466us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510325.672494:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788510325.672593:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510325.672645:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788510325.672703:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510325.672737:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cdaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510325.680114:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861021312 00000100:00100000:1.0:1788510325.680130:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861021312 00000100:00100000:1.0:1788510325.680184:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788510325.680194:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861021312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510325.680483:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861021312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 290us (7779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510325.680492:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788510325.681285:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510325.683852:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8444:1875388861021440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510325.683951:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510325.684004:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8560b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788510325.685692:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861021440 00000100:00100000:1.0:1788510325.685706:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861021440 00000100:00100000:1.0:1788510325.685770:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788510325.685782:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:8444:x1875388861021440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510325.686092:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:8444:x1875388861021440:12345-0@lo:502:llog_process_th.0 Request processed in 312us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510325.686099:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788510325.686264:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8444:1875388861021440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510325.686337:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8444:1875388861021568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510325.686387:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510325.686415:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cdaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510325.687031:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861021568 00000100:00100000:1.0:1788510325.687038:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861021568 00000100:00100000:1.0:1788510325.687070:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788510325.687086:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:8444:x1875388861021568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510325.687529:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:8444:x1875388861021568:12345-0@lo:502:llog_process_th.0 Request processed in 444us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510325.687537:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788510325.687773:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8444:1875388861021568:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788510325.687800:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788510325.689441:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788510325.689473:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788510325.689485:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510325.689497:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510325.689507:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788510325.689510:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788510325.689513:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788510325.689550:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510325.689559:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510325.689569:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510325.689591:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788510325.689646:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510325.689711:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c92180 going to sleep for 11 seconds 00000100:00100000:2.0:1788510325.689857:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861021696 00000100:00100000:2.0:1788510325.689870:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861021696 00000100:00100000:2.0:1788510325.689954:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788510325.689965:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861021696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510325.689977:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510325.689994:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fce00/0x3e734462ed653c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed653c2 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.690052:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fce00/0x3e734462ed653c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed653c2 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.690070:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fce00/0x3e734462ed653c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed653c2 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.690109:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fce00, rc 0) 00000100:00100000:2.0:1788510325.690198:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861021696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510325.690205:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788510325.690487:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788510325.690512:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510325.690521:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510325.690571:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510325.690598:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510325.690663:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c92180 going to sleep for 11 seconds 00000100:00100000:0.0:1788510325.693659:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861021824 00000100:00100000:0.0:1788510325.693680:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861021824 00000100:00100000:0.0:1788510325.693808:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788510325.693821:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861021824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510325.694255:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861021824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 436us (3654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510325.694263:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788510325.694359:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510325.694418:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788510325.694481:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510325.702387:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82cdaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510325.703821:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861021952 00000100:00100000:1.0:1788510325.703834:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861021952 00000100:00100000:3.0:1788510325.704363:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788510325.704376:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861021952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788510325.704718:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861021952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 343us (10236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.704728:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788510325.704805:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861021952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510325.705721:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8445:1875388861022080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510325.705799:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510325.705845:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.705894:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861022080 00000100:00100000:3.0:1788510325.705902:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861022080 00000100:00100000:3.0:1788510325.705949:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788510325.705959:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8445:x1875388861022080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510325.706202:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8445:x1875388861022080:12345-0@lo:502:llog_process_th.0 Request processed in 244us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.706208:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788510325.707085:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8445:1875388861022080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788510325.707123:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788510325.707134:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510325.707136:0:8445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788510325.707143:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788510325.707176:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8445:1875388861022208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510325.707264:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510325.707300:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788510325.707415:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861022208 00000100:00100000:3.0:1788510325.707420:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861022208 00000100:00100000:3.0:1788510325.707577:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788510325.707590:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8445:x1875388861022208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510325.707865:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8445:x1875388861022208:12345-0@lo:502:llog_process_th.0 Request processed in 277us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510325.707873:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788510325.708109:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8445:1875388861022208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788510325.708134:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788510325.708140:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510325.708142:0:8445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788510325.708146:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788510325.708464:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788510325.708485:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788510325.708496:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.708508:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510325.708518:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788510325.708521:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff929a84fbcd40 from 1 10000000:01000000:0.0:1788510325.708524:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788510325.708553:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed653d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.708562:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed653d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.708571:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed653d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510325.708590:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861022336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788510325.708634:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510325.708674:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510325.708801:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861022336 00000100:00100000:2.0:1788510325.708806:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861022336 00000100:00100000:2.0:1788510325.708847:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788510325.708856:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861022336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510325.708868:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510325.708892:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fc600/0x3e734462ed653d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed653d0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.708916:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fc600/0x3e734462ed653d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed653d0 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.708927:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fc600/0x3e734462ed653d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed653d0 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510325.708937:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fc600, rc 0) 00000100:00100000:2.0:1788510325.708970:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861022336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510325.708976:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788510325.713018:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861022336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510325.713073:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed653d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653d7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.713111:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed653d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed653d7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510325.714374:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861022464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510325.714539:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510325.714589:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788510325.714617:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861022464 00000100:00100000:0.0:1788510325.714626:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861022464 00000100:00100000:0.0:1788510325.714669:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788510325.714679:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861022464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510325.714947:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861022464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (408us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788510325.714956:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788510325.715001:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861022464:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788510325.715045:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788510325.715056:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed653d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653d7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510325.715066:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed653d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653d7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510326.020823:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510326.373827:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510326.374009:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852605696 00000100:00100000:0.0:1788510326.374029:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852605696 00000100:00100000:0.0:1788510326.374131:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 164 00000100:00100000:0.0:1788510326.374141:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+8:5585:x1875388852605696:12345-192.168.201.4@tcp:101: 00010000:00010000:0.0:1788510326.374173:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510326.374190:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a80030400/0x3e734462ed653de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7313e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510326.374214:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80030400/0x3e734462ed653de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7313e expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510326.374255:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a80030400/0x3e734462ed653de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7313e expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510326.374263:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a80030400, rc 0) 00000100:00100000:0.0:1788510326.374312:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:5585:x1875388852605696:12345-192.168.201.4@tcp:101: Request processed in 174us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510326.374317:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 164 00000100:00100000:1.0:1788510326.391695:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510326.391798:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852605824 00000100:00100000:3.0:1788510326.391808:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852605824 00000100:00100000:3.0:1788510326.391862:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 165 00000100:00100000:3.0:1788510326.391874:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:5585:x1875388852605824:12345-192.168.201.4@tcp:501: 00000100:00100000:3.0:1788510326.392198:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:5585:x1875388852605824:12345-192.168.201.4@tcp:501: Request processed in 326us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510326.392206:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 165 00000100:00100000:3.0:1788510326.394720:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510326.394967:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852605952 00000100:00100000:0.0:1788510326.394980:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852605952 00000100:00100000:0.0:1788510326.395107:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 166 00000100:00100000:0.0:1788510326.395118:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:5585:x1875388852605952:12345-192.168.201.4@tcp:503: 00000100:00100000:3.0:1788510326.396598:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:5585:x1875388852605952:12345-192.168.201.4@tcp:503: Request processed in 1470us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510326.396610:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 166 00000100:00100000:1.0:1788510326.415976:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510326.416798:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852606080 00000100:00100000:3.0:1788510326.416812:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852606080 00000100:00100000:3.0:1788510326.416886:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 167 00000100:00100000:3.0:1788510326.416899:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:6057:x1875388852606080:12345-192.168.201.4@tcp:502: 00000100:00100000:3.0:1788510326.417409:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:6057:x1875388852606080:12345-192.168.201.4@tcp:502: Request processed in 511us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510326.417418:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 167 00000100:00100000:1.0:1788510326.425475:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510326.425579:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852606208 00000100:00100000:3.0:1788510326.425602:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852606208 00000100:00100000:3.0:1788510326.425685:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 168 00000100:00100000:3.0:1788510326.425695:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:6057:x1875388852606208:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788510326.425994:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:6057:x1875388852606208:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 299us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510326.426003:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 168 00000100:00100000:0.0:1788510326.429086:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510326.429185:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852606336 00000100:00100000:3.0:1788510326.429196:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852606336 00000100:00100000:3.0:1788510326.430856:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 169 00000100:00100000:3.0:1788510326.430873:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:5585:x1875388852606336:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788510326.430893:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510326.430916:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81532e00/0x3e734462ed653e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73145 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510326.430946:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81532e00/0x3e734462ed653e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73145 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510326.430957:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81532e00/0x3e734462ed653e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73145 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510326.430965:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81532e00, rc 0) 00000100:00100000:3.0:1788510326.431045:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5585:x1875388852606336:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 Request processed in 177us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510326.431053:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 169 00000100:00100000:1.0:1788510326.440408:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510326.449172:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852606464 00000100:00100000:3.0:1788510326.449193:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852606464 00000100:00100000:3.0:1788510326.449291:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 170 00000100:00100000:3.0:1788510326.449303:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5585:x1875388852606464:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510326.449616:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5585:x1875388852606464:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 Request processed in 313us (9218us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788510326.449625:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 170 00010000:00010000:3.0:1788510327.044827:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788510327.461826:0:8482:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc7a1e5d0 20000000:00000080:3.0:1788510327.461846:0:8482:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff929abb171c00 uarg=0000000000000000 20000000:01000000:3.0:1788510327.461887:0:8482:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788510327.461895:0:8482:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788510327.461899:0:8482:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788510327.462947:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788510327.463127:0:8482:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788510327.468212:0:8482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788510327.468473:0:8482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788510327.468529:0:8482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788510327.468546:0:8482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788510327.468566:0:8482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.468585:0:8482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a80031600/0x3e734462ed65161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6515a expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.468593:0:8482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a813fc400/0x3e734462ed651c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed651bc expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.468600:0:8482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a83033c00/0x3e734462ed6528e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65287 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.468642:0:8482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a80030a00/0x3e734462ed6534b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7310d expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.468650:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.468689:0:8482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a80030a00/0x3e734462ed6534b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7310d expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.468705:0:8482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a80030a00/0x3e734462ed6534b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7310d expref: 9 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510327.468720:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8482:1875388861022592:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510327.468835:0:8482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a83033c00/0x3e734462ed6528e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed65287 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.468843:0:8482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a83033c00/0x3e734462ed6528e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed65287 expref: 18 pid: 5816 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510327.468854:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8482:1875388861022720:0@lo:104: 00000100:00100000:2.0:1788510327.468895:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788510327.468925:0:8482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a813fc400/0x3e734462ed651c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed651bc expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.468933:0:8482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a813fc400/0x3e734462ed651c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed651bc expref: 18 pid: 5816 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510327.468941:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8482:1875388861022848:0@lo:104: 00000100:00100000:2.0:1788510327.468974:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788510327.469012:0:8482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a80031600/0x3e734462ed65161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6515a expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.469020:0:8482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a80031600/0x3e734462ed65161 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6515a expref: 18 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510327.469028:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8482:1875388861022976:0@lo:104: 00000100:00100000:2.0:1788510327.469047:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510327.472411:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510327.472457:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852606592 00000100:00100000:3.0:1788510327.472466:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852606592 00010000:00010000:3.0:1788510327.472516:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a80030a00/0x3e734462ed6534b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7310d expref: 10 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510327.472558:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:3.0:1788510327.472568:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2340:x1875388852606592:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510327.472587:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510327.472593:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a80030a00/0x3e734462ed6534b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7310d expref: 10 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.472607:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a80030a00/0x3e734462ed6534b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7310d expref: 10 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.472647:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510327.472712:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2340:x1875388852606592:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 144us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510327.472720:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 21 00010000:00010000:2.0:1788510327.474273:0:8482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80030a00/0x3e734462ed6534b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7310d expref: 9 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510327.474295:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8482:1875388861022592:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510327.474535:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788510327.474568:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510327.474602:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861022720 00000100:00100000:0.0:1788510327.474609:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861022720 00000100:00100000:3.0:1788510327.474711:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861022848 00000100:00100000:3.0:1788510327.474715:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861022848 00000100:00100000:3.0:1788510327.474746:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861022976 00000100:00100000:3.0:1788510327.474749:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861022976 00000100:00100000:3.0:1788510327.474763:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788510327.474772:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299823de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+5:8482:x1875388861022848:12345-0@lo:104: 00010000:00010000:3.0:1788510327.474788:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.474856:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788510327.474862:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299823de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+5:8482:x1875388861022848:12345-0@lo:104: Request processed in 92us (5888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510327.474868:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788510327.474883:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788510327.474888:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+4:8482:x1875388861022976:12345-0@lo:104: 00010000:00010000:3.0:1788510327.474896:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6515a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.474927:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788510327.474932:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+4:8482:x1875388861022976:12345-0@lo:104: Request processed in 44us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510327.474937:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788510327.474952:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788510327.474957:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.474964:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81679400 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510327.474967:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.475003:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510327.475012:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510327.475017:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788510327.475054:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.475060:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510327.475080:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.475086:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81679400/0x3e734462ed651bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed651c3 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.475099:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510327.475102:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6515a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.475107:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc800 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510327.475110:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6515a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.475115:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6515a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510327.475120:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6515a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510327.475131:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788510327.475526:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6515a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.475534:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510327.475541:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6515a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.475548:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6515a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65161 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.475557:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510327.475558:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510327.475560:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510327.475569:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510327.475584:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861023104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788510327.475625:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510327.475752:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788510327.475762:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+3:8482:x1875388861022720:12345-0@lo:104: 00010000:00010000:0.0:1788510327.475770:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510327.475823:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788510327.475829:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+3:8482:x1875388861022720:12345-0@lo:104: Request processed in 70us (6935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510327.475835:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788510327.476024:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788510327.476032:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861023232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788510327.476056:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510327.476090:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861023104 00000100:00100000:3.0:1788510327.476095:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861023104 00010000:00010000:3.0:1788510327.476117:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a813fc400/0x3e734462ed651c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed651bc expref: 19 pid: 5816 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510327.476138:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861023232 00000100:00100000:3.0:1788510327.476141:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861023232 00010000:00010000:3.0:1788510327.476152:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a80031600/0x3e734462ed65161 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6515a expref: 20 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510327.476179:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788510327.476185:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+20:3288:x1875388861023104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788510327.476196:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510327.476201:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a813fc400/0x3e734462ed651c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed651bc expref: 20 pid: 5816 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.476211:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a813fc400/0x3e734462ed651c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed651bc expref: 20 pid: 5816 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.476257:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510327.476286:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+20:3288:x1875388861023104:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510327.476293:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788510327.476305:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788510327.476311:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861023232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788510327.476318:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510327.476323:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a80031600/0x3e734462ed65161 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6515a expref: 19 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.476330:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a80031600/0x3e734462ed65161 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6515a expref: 19 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510327.476338:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510327.476358:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861023232:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510327.476364:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788510327.476417:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861023232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788510327.476435:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861023104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788510327.476724:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8482:1875388861022720:0@lo:104: 00010000:00010000:2.0:1788510327.476736:0:8482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fc400/0x3e734462ed651c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed651bc expref: 18 pid: 5816 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510327.476750:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8482:1875388861022848:0@lo:104: 00010000:00010000:2.0:1788510327.476759:0:8482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80031600/0x3e734462ed65161 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6515a expref: 17 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510327.476768:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8482:1875388861022976:0@lo:104: 00010000:00010000:2.0:1788510327.476798:0:8482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.477787:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510327.477799:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.477810:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81532200 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510327.477816:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.477825:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510327.477832:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510327.477837:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788510327.477990:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478007:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510327.478047:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478054:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81532200/0x3e734462ed65287 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6528e expref: -99 pid: 7603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478071:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510327.478073:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510327.478074:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510327.478111:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788510327.478127:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861023360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788510327.478183:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510327.478296:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861023360 00000100:00100000:1.0:1788510327.478303:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861023360 00010000:00010000:1.0:1788510327.478333:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a83033c00/0x3e734462ed6528e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65287 expref: 17 pid: 5816 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510327.478366:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788510327.478376:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:3291:x1875388861023360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510327.478387:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510327.478392:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a83033c00/0x3e734462ed6528e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65287 expref: 17 pid: 5816 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478403:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a83033c00/0x3e734462ed6528e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed65287 expref: 17 pid: 5816 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478417:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83033c00/0x3e734462ed6528e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed65287 expref: 17 pid: 5816 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478430:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478446:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478464:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478471:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478478:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478484:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478490:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510327.478494:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478502:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478517:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510327.478527:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510327.478563:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3291:x1875388861023360:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510327.478570:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788510327.478871:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861023360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788510327.478947:0:8482:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.478956:0:8482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510327.478971:0:8482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fd000/0x3e734462ed653ec lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510327.492530:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861023872:0@lo:400:kworker.0 00000100:00100000:3.0:1788510327.492625:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510327.492675:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788510327.492682:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861023488:0@lo:400:kworker.0 00000100:00100000:3.0:1788510327.492706:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510327.492722:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861024000:0@lo:400:kworker.0 00000100:00100000:3.0:1788510327.492748:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510327.492780:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861024000 00000100:00100000:3.0:1788510327.492788:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861024000 00000100:00100000:3.0:1788510327.492849:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788510327.492859:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861024000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510327.492914:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861024000:12345-0@lo:400:kworker.0 Request processed in 56us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510327.492922:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788510327.492947:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788510327.492962:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861023744:0@lo:400:kworker.0 00000100:00100000:3.0:1788510327.492989:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510327.493020:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788510327.493025:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861023616:0@lo:400:kworker.0 00000100:00100000:3.0:1788510327.493060:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510327.493084:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861023744 00000100:00100000:3.0:1788510327.493088:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861023744 00000100:00100000:3.0:1788510327.493120:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788510327.493126:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861023744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510327.493161:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861023744:12345-0@lo:400:kworker.0 Request processed in 35us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510327.493167:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788510327.493182:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788510327.493206:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaee5ce00 x1875388861023744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510327.493247:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861023744:0@lo:400:kworker.0 00010000:00080000:3.0:1788510327.493284:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaee5dc00 x1875388861024000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510327.493292:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861024000:0@lo:400:kworker.0 00000100:00100000:2.0:1788510327.493429:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861023872 00000100:00100000:2.0:1788510327.493434:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861023872 00000100:00100000:2.0:1788510327.493468:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861023488 00000100:00100000:2.0:1788510327.493471:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861023488 00000100:00100000:2.0:1788510327.493482:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861023616 00000100:00100000:2.0:1788510327.493484:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861023616 00000100:00100000:2.0:1788510327.493497:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788510327.493503:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861023872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510327.493545:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861023872:12345-0@lo:400:kworker.0 Request processed in 42us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510327.493553:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788510327.493566:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788510327.493571:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861023488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510327.493597:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861023488:12345-0@lo:400:kworker.0 Request processed in 26us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510327.493603:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788510327.493613:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788510327.493620:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861023616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510327.493665:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861023616:12345-0@lo:400:kworker.0 Request processed in 45us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510327.493671:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788510327.493702:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861023616:0@lo:400:kworker.0 00000100:00100000:2.0:1788510327.493723:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861023488:0@lo:400:kworker.0 00000100:00100000:2.0:1788510327.493745:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861023872:0@lo:400:kworker.0 00000100:00080000:3.0:1788510327.494833:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510328.005355:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861024128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788510328.005438:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510328.005777:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861024128 00000100:00100000:0.0:1788510328.005786:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861024128 00000100:00100000:0.0:1788510328.006806:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788510328.006826:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861024128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788510328.006867:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510328.006961:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861024128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510328.006970:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788510328.007070:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a8578ea00 x1875388861024128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510328.007096:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861024128:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788510328.068588:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788510328.773517:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788510328.773531:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929a85c6b800 from 4 10000000:01000000:0.0:1788510328.773540:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788510328.773657:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510328.773674:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510328.773690:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510328.773726:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861024256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788510328.773827:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510328.773897:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510328.774246:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861024256 00000100:00100000:2.0:1788510328.774255:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861024256 00000100:00100000:2.0:1788510328.774301:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788510328.774309:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861024256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510328.774324:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510328.774337:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fc400/0x3e734462ed653fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed653f3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.774363:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fc400/0x3e734462ed653fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed653f3 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.774374:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fc400/0x3e734462ed653fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed653f3 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.774382:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fc400, rc 0) 00000100:00100000:2.0:1788510328.774421:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861024256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510328.774427:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788510328.774781:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861024256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510328.774812:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510328.774821:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510328.774879:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861024384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510328.774909:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510328.774944:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510328.775006:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861024384 00000100:00100000:2.0:1788510328.775011:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861024384 00000100:00100000:2.0:1788510328.775040:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788510328.775048:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861024384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.775337:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861024384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510328.775345:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788510328.775428:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861024384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510328.775458:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861024512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510328.775496:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510328.775656:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510328.775858:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861024512 00000100:00100000:2.0:1788510328.775866:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861024512 00000100:00100000:2.0:1788510328.775992:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788510328.776005:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861024512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.776322:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861024512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 318us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510328.776333:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788510328.781101:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861024512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.787095:0:8513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8513:1875388861024640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510328.787834:0:8513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510328.788882:0:8513:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89466840 going to sleep for 11 seconds 00000100:00100000:0.0:1788510328.792444:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861024640 00000100:00100000:0.0:1788510328.792471:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861024640 00000100:00100000:0.0:1788510328.793756:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788510328.793778:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:8513:x1875388861024640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510328.794187:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:8513:x1875388861024640:12345-0@lo:502:llog_process_th.0 Request processed in 412us (6352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510328.794201:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788510328.794720:0:8513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8513:1875388861024640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788510328.794792:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510328.794808:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510328.794813:0:8513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788510328.794828:0:8513:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff929a85c6b800 00000020:00000080:1.0:1788510328.794833:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788510328.794995:0:8513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8513:1875388861024768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510328.795050:0:8513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510328.795106:0:8513:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510328.795333:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861024768 00000100:00100000:2.0:1788510328.795348:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861024768 00000100:00100000:2.0:1788510328.795432:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788510328.795448:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:8513:x1875388861024768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510328.795797:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:8513:x1875388861024768:12345-0@lo:502:llog_process_th.0 Request processed in 351us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510328.795809:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788510328.796039:0:8513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8513:1875388861024768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788510328.796074:0:8513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510328.796083:0:8513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510328.796086:0:8513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788510328.796096:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788510328.796331:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788510328.796360:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788510328.796377:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.796394:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510328.796424:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788510328.796429:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929ab4b11000 from 4 10000000:01000000:2.0:1788510328.796435:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788510328.796486:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.796500:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.796514:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510328.796548:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861024896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.796636:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510328.796674:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89466840 going to sleep for 11 seconds 00000100:00100000:2.0:1788510328.796704:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861024896 00000100:00100000:2.0:1788510328.796713:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861024896 00000100:00100000:2.0:1788510328.796771:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788510328.796788:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861024896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510328.796809:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510328.796831:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fd000/0x3e734462ed65408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65401 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.796861:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fd000/0x3e734462ed65408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65401 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.796877:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fd000/0x3e734462ed65408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65401 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.796909:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fd000, rc 0) 00000100:00100000:2.0:1788510328.796964:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861024896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510328.796981:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788510328.797040:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861024896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510328.797061:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.797074:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510328.797146:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861025024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.797190:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510328.797217:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89466840 going to sleep for 11 seconds 00000100:00100000:1.0:1788510328.803117:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861025024 00000100:00100000:1.0:1788510328.803138:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861025024 00000100:00100000:1.0:1788510328.803210:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788510328.803274:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861025024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510328.804541:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861025024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1310us (7340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510328.804559:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788510328.804862:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861025024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.804953:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861025152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.805049:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510328.805112:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89466840 going to sleep for 11 seconds 00000100:00100000:2.0:1788510328.805145:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861025152 00000100:00100000:2.0:1788510328.805153:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861025152 00000100:00100000:2.0:1788510328.805211:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788510328.805274:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861025152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.805574:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861025152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 348us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510328.807845:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788510328.808030:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861025152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510328.811289:0:8516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8516:1875388861025280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510328.811437:0:8516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510328.811507:0:8516:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4da0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788510328.811818:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861025280 00000100:00100000:2.0:1788510328.811831:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861025280 00000100:00100000:2.0:1788510328.811915:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788510328.811930:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8516:x1875388861025280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510328.812359:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8516:x1875388861025280:12345-0@lo:502:llog_process_th.0 Request processed in 429us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510328.812373:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788510328.812937:0:8516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8516:1875388861025280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788510328.813002:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788510328.813018:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510328.813022:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788510328.813035:0:8516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff929ab4b11000 00000020:00000080:0.0:1788510328.813041:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788510328.813162:0:8516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8516:1875388861025408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510328.813291:0:8516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510328.813338:0:8516:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4da0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788510328.818871:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861025408 00000100:00100000:2.0:1788510328.818897:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861025408 00000100:00100000:2.0:1788510328.818996:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788510328.819010:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8516:x1875388861025408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510328.819488:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:8516:x1875388861025408:12345-0@lo:502:llog_process_th.0 Request processed in 477us (6193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510328.819503:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788510328.820989:0:8516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8516:1875388861025408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788510328.821059:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788510328.821073:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510328.821077:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788510328.821085:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788510328.822667:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788510328.822699:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788510328.822712:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.822726:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510328.822736:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788510328.822739:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929a82ae6000 from 4 10000000:01000000:2.0:1788510328.822749:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788510328.822789:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.822798:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.822810:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510328.822838:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861025536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.822908:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510328.822954:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788510328.823093:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861025536 00000100:00100000:0.0:1788510328.823101:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861025536 00000100:00100000:0.0:1788510328.823146:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788510328.823156:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861025536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510328.823169:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510328.823182:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a80031a00/0x3e734462ed65416 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6540f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510328.823205:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80031a00/0x3e734462ed65416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6540f expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510328.823216:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a80031a00/0x3e734462ed65416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6540f expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510328.823484:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a80031a00, rc 0) 00000100:00100000:0.0:1788510328.823562:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861025536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 405us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510328.823587:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788510328.823966:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861025536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510328.823995:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510328.824008:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510328.824102:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861025664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.824156:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510328.824198:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510328.824259:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861025664 00000100:00100000:2.0:1788510328.824268:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861025664 00000100:00100000:2.0:1788510328.824319:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788510328.824332:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861025664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.825175:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861025664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 845us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510328.825190:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788510328.825265:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861025664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.825302:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861025792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510328.825343:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510328.825360:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788510328.825528:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861025792 00000100:00100000:0.0:1788510328.825540:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861025792 00000100:00100000:0.0:1788510328.825632:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788510328.825648:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861025792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510328.825861:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861025792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510328.825868:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788510328.825913:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861025792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510328.836817:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8517:1875388861025920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510328.836940:0:8517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510328.836995:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861025920 00000100:00100000:0.0:1788510328.837003:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861025920 00000100:00100000:0.0:1788510328.837042:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788510328.837051:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:8517:x1875388861025920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510328.837358:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:8517:x1875388861025920:12345-0@lo:502:llog_process_th.0 Request processed in 305us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510328.837370:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788510328.842005:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4da0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788510328.842064:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8517:1875388861025920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788510328.842129:0:8517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788510328.842146:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510328.842149:0:8517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788510328.842160:0:8517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff929a82ae6000 00000020:00000080:0.0:1788510328.842166:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788510328.842357:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8517:1875388861026048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510328.842468:0:8517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510328.844921:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4da0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788510328.845003:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861026048 00000100:00100000:2.0:1788510328.845014:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861026048 00000100:00100000:2.0:1788510328.845149:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788510328.845164:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:8517:x1875388861026048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510328.845550:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:8517:x1875388861026048:12345-0@lo:502:llog_process_th.0 Request processed in 387us (3080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510328.845562:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788510328.845839:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:8517:1875388861026048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788510328.845893:0:8517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510328.845904:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510328.845906:0:8517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788510328.845912:0:8517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788510328.847827:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788510328.847883:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788510328.847902:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510328.847933:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510328.868216:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510328.869027:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852606720 00000100:00100000:0.0:1788510328.869039:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852606720 00000100:00100000:0.0:1788510328.869267:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 186 00000100:00100000:0.0:1788510328.869286:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:5585:x1875388852606720:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510328.869308:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510328.869338:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a80030a00/0x3e734462ed6541d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7314c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510328.869377:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80030a00/0x3e734462ed6541d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7314c expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510328.869393:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a80030a00/0x3e734462ed6541d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7314c expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510328.869406:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a80030a00, rc 0) 00000100:00100000:0.0:1788510328.869483:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5585:x1875388852606720:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 Request processed in 202us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510328.869494:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 186 00000100:00100000:2.0:1788510328.887550:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510328.890152:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852606848 00000100:00100000:0.0:1788510328.890172:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852606848 00000100:00100000:0.0:1788510328.890343:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 187 00000100:00100000:0.0:1788510328.890364:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5585:x1875388852606848:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510328.890982:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5585:x1875388852606848:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 Request processed in 614us (7813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510328.891002:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 187 00000100:00100000:3.0:1788510328.894324:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510328.901064:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852606976 00000100:00100000:1.0:1788510328.901091:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852606976 00000100:00100000:1.0:1788510328.901190:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 188 00000100:00100000:1.0:1788510328.901209:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5585:x1875388852606976:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510328.901537:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:5585:x1875388852606976:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 Request processed in 332us (7224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510328.901551:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 188 00000100:00100000:1.0:1788510328.913282:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510328.914329:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852607104 00000100:00100000:1.0:1788510328.914340:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852607104 00000100:00100000:1.0:1788510328.914414:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 189 00000100:00100000:1.0:1788510328.914431:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:6114:x1875388852607104:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788510328.914715:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:6114:x1875388852607104:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 290us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510328.914723:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 189 00000100:00100000:3.0:1788510328.937130:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510328.937203:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852607232 00000100:00100000:1.0:1788510328.937215:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852607232 00000100:00100000:1.0:1788510328.937301:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 190 00000100:00100000:1.0:1788510328.937311:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:6114:x1875388852607232:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788510328.937554:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:6114:x1875388852607232:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 243us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510328.937572:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 190 00010000:00010000:1.0:1788510329.093568:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510329.447001:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510329.447082:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510329.447169:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510329.447268:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852607616 00000100:00100000:3.0:1788510329.447301:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852607616 00000100:00100000:3.0:1788510329.447364:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852607488 00000100:00100000:3.0:1788510329.447367:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852607488 00000100:00100000:3.0:1788510329.447390:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:3.0:1788510329.447401:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852607616:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510329.447490:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852607616:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 90us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510329.447497:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:3.0:1788510329.447514:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:3.0:1788510329.447520:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852607488:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510329.447541:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852607488:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 22us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510329.447546:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00080000:3.0:1788510329.447563:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788510329.447568:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788510329.447714:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852607360 00000100:00100000:0.0:1788510329.447719:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852607360 00000100:00100000:0.0:1788510329.447760:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00100000:0.0:1788510329.447767:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852607360:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510329.447807:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852607360:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 41us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510329.447816:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00080000:3.0:1788510329.447950:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788510330.124497:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510330.566493:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861026176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788510330.566591:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510330.569400:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861026176 00000100:00100000:1.0:1788510330.569418:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861026176 00000100:00100000:1.0:1788510330.569491:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788510330.569502:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861026176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788510330.569541:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510330.569625:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861026176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (3035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510330.569632:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788510330.569656:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788510330.569695:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd7b80 x1875388861026176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510330.569718:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861026176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788510331.142251:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510332.165172:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510332.622483:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861026304:0@lo:400:kworker.0 00000100:00100000:3.0:1788510332.622575:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510332.623866:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861026432:0@lo:400:kworker.0 00000100:00100000:0.0:1788510332.623957:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510332.624017:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861026432 00000100:00100000:0.0:1788510332.624028:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861026432 00000100:00100000:0.0:1788510332.624087:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788510332.624095:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861026432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510332.624169:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861026432:12345-0@lo:400:kworker.0 Request processed in 64us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510332.624176:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788510332.624251:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861026432:0@lo:400:kworker.0 00000100:00100000:3.0:1788510332.626762:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861026304 00000100:00100000:3.0:1788510332.626779:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861026304 00000100:00100000:3.0:1788510332.626843:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788510332.626852:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861026304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510332.626940:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861026304:12345-0@lo:400:kworker.0 Request processed in 89us (4365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510332.626947:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788510332.627006:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861026304:0@lo:400:kworker.0 00000100:00100000:2.0:1788510332.627594:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861026560:0@lo:400:kworker.0 00000100:00100000:2.0:1788510332.627636:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510332.627687:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788510332.627693:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861026688:0@lo:400:kworker.0 00000100:00100000:2.0:1788510332.627718:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510332.627749:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861026560 00000100:00100000:2.0:1788510332.627753:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861026560 00000100:00100000:2.0:1788510332.627792:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788510332.627800:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861026560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510332.627844:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861026560:12345-0@lo:400:kworker.0 Request processed in 45us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510332.627851:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788510332.627871:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861026688 00000100:00100000:2.0:1788510332.627874:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861026688 00000100:00100000:2.0:1788510332.627918:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788510332.627925:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861026688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510332.627955:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861026688:12345-0@lo:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510332.627963:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788510332.627977:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788510332.627982:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788510332.628004:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abae65500 x1875388861026688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510332.628016:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861026688:0@lo:400:kworker.0 00000100:00100000:2.0:1788510332.628026:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861026560:0@lo:400:kworker.0 00000100:00100000:3.0:1788510332.628336:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861026816:0@lo:400:kworker.0 00000100:00100000:3.0:1788510332.628470:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510332.628500:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788510332.628507:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861026944:0@lo:400:kworker.0 00000100:00100000:1.0:1788510332.628605:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861026816 00000100:00100000:1.0:1788510332.628610:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861026816 00000100:00100000:1.0:1788510332.628654:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788510332.628662:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861026816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510332.628805:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861026816:12345-0@lo:400:kworker.0 Request processed in 141us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510332.628816:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788510332.628926:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510332.628972:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861026816:0@lo:400:kworker.0 00000100:00100000:1.0:1788510332.629034:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861026944 00000100:00100000:1.0:1788510332.629042:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861026944 00000100:00100000:1.0:1788510332.629092:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788510332.629098:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861026944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510332.629251:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861026944:12345-0@lo:400:kworker.0 Request processed in 123us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510332.629258:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788510332.629306:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abae64a80 x1875388861026944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510332.629320:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861026944:0@lo:400:kworker.0 00000100:00080000:2.0:1788510332.630093:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788510332.630101:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510333.128997:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861027072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510333.129077:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510333.129156:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861027072 00000100:00100000:2.0:1788510333.129164:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861027072 00000100:00100000:2.0:1788510333.129215:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788510333.129259:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861027072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788510333.129296:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510333.129343:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861027072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510333.129357:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788510333.129415:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd5500 x1875388861027072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510333.129435:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861027072:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788510333.194309:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510334.213525:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510334.575043:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510334.575081:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510334.575103:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510334.575127:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510334.575156:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852608000 00000100:00100000:1.0:1788510334.575167:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852608000 00000100:00100000:1.0:1788510334.575240:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852608128 00000100:00100000:1.0:1788510334.575243:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852608128 00000100:00100000:1.0:1788510334.575265:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:1.0:1788510334.575276:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2340:x1875388852608000:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510334.575371:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2340:x1875388852608000:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 98us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510334.575379:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:1.0:1788510334.575395:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:1.0:1788510334.575401:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2340:x1875388852608128:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510334.575421:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2340:x1875388852608128:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 20us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510334.575427:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:1.0:1788510334.575442:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852607872 00000100:00100000:1.0:1788510334.575457:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852607872 00000100:00100000:1.0:1788510334.575485:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 37 00000100:00100000:1.0:1788510334.575491:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852607872:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510334.575533:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852607872:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 41us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510334.575541:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 37 00000100:00080000:1.0:1788510334.575561:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788510334.575567:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510334.575569:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510334.576102:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852607744 00000100:00100000:0.0:1788510334.576108:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852607744 00000100:00100000:0.0:1788510334.576146:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 192 00000100:00100000:0.0:1788510334.576153:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2340:x1875388852607744:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510334.576189:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2340:x1875388852607744:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 38us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510334.576207:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 192 00010000:00010000:2.0:1788510335.238120:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510335.684682:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788510335.684713:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861027200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788510335.684807:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510335.684912:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861027200 00000100:00100000:2.0:1788510335.684922:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861027200 00000100:00100000:2.0:1788510335.684999:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788510335.685010:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861027200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510335.685058:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510335.685113:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861027200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510335.685121:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788510335.685146:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788510335.686014:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd5500 x1875388861027200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510335.686042:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861027200:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788510336.225673:0:8783:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788510336.268784:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510337.284691:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510337.733583:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861027456:0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.733660:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510337.733727:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861027968:0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.733755:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510337.733787:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788510337.733793:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861027328:0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.733854:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510337.733874:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861027840:0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.733896:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510337.733924:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861027584:0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.733946:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510337.733965:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510337.733970:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861027712:0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.734014:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510337.734048:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861027456 00000100:00100000:1.0:1788510337.734056:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861027456 00000100:00100000:1.0:1788510337.734091:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861027840 00000100:00100000:1.0:1788510337.734101:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861027840 00000100:00100000:1.0:1788510337.734128:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861027584 00000100:00100000:1.0:1788510337.734131:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861027584 00000100:00100000:1.0:1788510337.734147:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788510337.734154:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861027456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.734204:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861027456:12345-0@lo:400:kworker.0 Request processed in 50us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510337.734213:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788510337.734258:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788510337.734264:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861027840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.734293:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861027840:12345-0@lo:400:kworker.0 Request processed in 29us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510337.734299:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788510337.734309:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788510337.734315:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861027584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.734343:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861027584:12345-0@lo:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510337.734349:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788510337.734366:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861027968 00000100:00100000:1.0:1788510337.734369:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861027968 00000100:00100000:1.0:1788510337.734391:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861027712 00000100:00100000:1.0:1788510337.734393:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861027712 00000100:00100000:1.0:1788510337.734410:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788510337.734416:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861027968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.734447:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861027968:12345-0@lo:400:kworker.0 Request processed in 32us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510337.734453:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788510337.734471:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788510337.734477:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861027712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.734506:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861027712:12345-0@lo:400:kworker.0 Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510337.734512:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788510337.734535:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788510337.734539:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510337.734542:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788510337.734573:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abae67b80 x1875388861027712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510337.734587:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861027712:0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.734598:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861027584:0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.734631:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861027840:0@lo:400:kworker.0 00000100:00100000:1.0:1788510337.734641:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861027456:0@lo:400:kworker.0 00010000:00080000:1.0:1788510337.734650:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abae65500 x1875388861027968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510337.734658:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861027968:0@lo:400:kworker.0 00000100:00100000:2.0:1788510337.735325:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861027328 00000100:00100000:2.0:1788510337.735333:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861027328 00000100:00100000:2.0:1788510337.735377:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788510337.735385:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861027328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510337.735439:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861027328:12345-0@lo:400:kworker.0 Request processed in 54us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510337.735446:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788510337.735947:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861027328:0@lo:400:kworker.0 00000100:00100000:1.0:1788510338.251998:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861028096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788510338.252123:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510338.252257:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861028096 00000100:00100000:1.0:1788510338.252270:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861028096 00000100:00100000:1.0:1788510338.252351:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788510338.252366:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861028096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788510338.252445:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510338.252503:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861028096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510338.252510:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788510338.252566:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a8578f100 x1875388861028096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510338.252589:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861028096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788510338.308493:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510339.334529:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510339.697006:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510339.697060:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510339.697092:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510339.697120:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510339.697155:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852608512 00000100:00100000:1.0:1788510339.697166:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852608512 00000100:00100000:3.0:1788510339.697257:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852608256 00000100:00100000:1.0:1788510339.697262:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852608640 00000100:00100000:3.0:1788510339.697263:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852608256 00000100:00100000:1.0:1788510339.697270:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852608640 00000100:00100000:1.0:1788510339.697309:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:3.0:1788510339.697310:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 194 00000100:00100000:1.0:1788510339.697326:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2339:x1875388852608512:12345-192.168.201.4@tcp:9:kworker.0 00000100:00100000:3.0:1788510339.697337:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2342:x1875388852608256:12345-192.168.201.4@tcp:400:kworker.0 00000020:00000080:1.0:1788510339.697377:0:6670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65359 00000100:00080000:1.0:1788510339.697392:0:6670:0:(import.c:65:import_set_state_nolock()) ffff929a87d55800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788510339.697425:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2342:x1875388852608256:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 94us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510339.697433:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 194 00000001:00000004:1.0:1788510339.697447:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788510339.697605:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852608384 00000100:00100000:2.0:1788510339.697610:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852608384 00000100:00100000:2.0:1788510339.697668:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 41 00000100:00100000:2.0:1788510339.697677:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2342:x1875388852608384:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510339.697714:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2342:x1875388852608384:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 40us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510339.697720:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 41 00000100:00100000:1.0:1788510339.699386:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+2:2339:x1875388852608512:12345-192.168.201.4@tcp:9:kworker.0 Request processed in 2056us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510339.700314:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:1.0:1788510339.700346:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:1.0:1788510339.700359:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2339:x1875388852608640:12345-192.168.201.4@tcp:9:kworker.0 00000020:00000080:1.0:1788510339.700794:0:6670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65360 00000100:00080000:1.0:1788510339.700807:0:6670:0:(import.c:65:import_set_state_nolock()) ffff929a85c6b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788510339.700846:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1788510339.702085:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788510339.702093:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788510339.702095:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510339.702650:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+2:2339:x1875388852608640:12345-192.168.201.4@tcp:9:kworker.0 Request processed in 1352us (4585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510339.702664:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 11 00010000:00010000:1.0:1788510339.702822:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510339.706477:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510340.356436:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510340.804447:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510340.804471:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861028224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510340.804544:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510340.804610:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861028224 00000100:00100000:1.0:1788510340.804617:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861028224 00000100:00100000:1.0:1788510340.804668:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788510340.804678:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861028224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788510340.804716:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510340.804759:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861028224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510340.804788:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788510340.804837:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abae6a680 x1875388861028224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510340.804857:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861028224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788510340.804982:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788510341.389725:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788510342.161948:0:9028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing yml_node 00010000:00010000:1.0:1788510342.412044:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510342.852394:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861028480:0@lo:400:kworker.0 00000100:00100000:3.0:1788510342.852420:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861028608:0@lo:400:kworker.0 00000100:00100000:2.0:1788510342.857307:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861028736:0@lo:400:kworker.0 00000100:00100000:1.0:1788510342.857474:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510342.857553:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861028992:0@lo:400:kworker.0 00000100:00100000:1.0:1788510342.857597:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510342.857632:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788510342.857640:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861028352:0@lo:400:kworker.0 00000100:00100000:1.0:1788510342.857670:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510342.857693:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861028864:0@lo:400:kworker.0 00000100:00100000:1.0:1788510342.857715:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510342.857770:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861028480 00000100:00100000:1.0:1788510342.857791:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861028480 00000100:00100000:1.0:1788510342.857848:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861028864 00000100:00100000:1.0:1788510342.857851:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861028864 00000100:00100000:1.0:1788510342.857881:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788510342.857892:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861028480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510342.857956:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861028480:12345-0@lo:400:kworker.0 Request processed in 65us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510342.857963:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788510342.857979:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788510342.857985:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861028864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510342.858012:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861028864:12345-0@lo:400:kworker.0 Request processed in 28us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510342.858018:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788510342.858037:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861028992 00000100:00100000:1.0:1788510342.858040:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861028992 00000100:00100000:1.0:1788510342.858067:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788510342.858073:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861028992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510342.858102:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861028992:12345-0@lo:400:kworker.0 Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510342.858107:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788510342.858137:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861028352 00000100:00100000:1.0:1788510342.858141:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861028352 00000100:00100000:1.0:1788510342.858168:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788510342.858175:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861028352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510342.858205:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861028352:12345-0@lo:400:kworker.0 Request processed in 31us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510342.858211:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1788510342.858269:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510342.858274:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510342.858321:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861028352:0@lo:400:kworker.0 00000100:00100000:1.0:1788510342.858337:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861028864:0@lo:400:kworker.0 00010000:00080000:1.0:1788510342.858348:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaee5e680 x1875388861028992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510342.858359:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861028992:0@lo:400:kworker.0 00000100:00100000:1.0:1788510342.858370:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861028480:0@lo:400:kworker.0 00000100:00100000:3.0:1788510342.858959:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510342.861546:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861028608 00000100:00100000:1.0:1788510342.861565:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861028608 00000100:00100000:1.0:1788510342.861635:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788510342.861646:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861028608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510342.861762:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861028608:12345-0@lo:400:kworker.0 Request processed in 119us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510342.861771:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788510342.861863:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510342.861906:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861028608:0@lo:400:kworker.0 00000100:00100000:2.0:1788510342.862598:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510342.862735:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861028736 00000100:00100000:0.0:1788510342.862742:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861028736 00000100:00100000:0.0:1788510342.862807:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788510342.862817:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861028736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510342.862869:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861028736:12345-0@lo:400:kworker.0 Request processed in 54us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510342.862876:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788510342.862909:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd0000 x1875388861028736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510342.862921:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861028736:0@lo:400:kworker.0 00000100:00080000:1.0:1788510342.863131:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510343.378589:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861029120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510343.378666:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510343.378759:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861029120 00000100:00100000:0.0:1788510343.378768:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861029120 00000100:00100000:0.0:1788510343.378828:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788510343.378837:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861029120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788510343.378875:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510343.378917:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861029120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510343.378924:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788510343.378975:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaee5dc00 x1875388861029120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510343.378993:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861029120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788510343.429038:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788510343.503083:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000020:00000080:1.0:1788510343.503093:0:6692:0:(genops.c:885:class_export_put()) final put ffff929a87d53800/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000020:00000080:3.0:1788510343.504648:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929a87d53800/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f for lustre-OST0000 00000020:00000080:3.0:1788510343.504709:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929a87d55800 for lustre-OST0000 00000001:00100000:3.0:1788510343.954424:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000020:00000080:3.0:1788510343.954435:0:7621:0:(genops.c:885:class_export_put()) final put ffff929a85c68000/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000020:00000080:0.0:1788510343.954638:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff929a85c68000/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f for lustre-OST0001 00000020:00000080:0.0:1788510343.954688:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929a85c6b000 for lustre-OST0001 00010000:00010000:1.0:1788510344.452613:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510344.813576:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510344.813634:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510344.814137:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852608768 00000100:00100000:2.0:1788510344.814148:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852608768 00000100:00100000:2.0:1788510344.814218:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 196 00000100:00100000:2.0:1788510344.814260:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2341:x1875388852608768:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510344.814339:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2341:x1875388852608768:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 80us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510344.814346:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 196 00000100:00100000:1.0:1788510344.816704:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852608896 00000100:00100000:1.0:1788510344.816726:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852608896 00000100:00100000:1.0:1788510344.816845:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 45 00000100:00100000:1.0:1788510344.816857:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852608896:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510344.816956:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852608896:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 100us (3391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510344.816963:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 45 00000100:00080000:2.0:1788510344.818165:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788510345.476469:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510345.924743:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788510345.924766:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861029248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788510345.924851:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510345.925051:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861029248 00000100:00100000:1.0:1788510345.925060:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861029248 00000100:00100000:1.0:1788510345.925144:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788510345.925154:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861029248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788510345.925200:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510345.925265:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861029248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510345.925272:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788510345.925459:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abae68e00 x1875388861029248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510345.925499:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861029248:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788510345.927347:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788510346.502425:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510347.525599:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788510347.786519:0:9222:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.4 00000100:00100000:1.0:1788510347.978478:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861029504:0@lo:400:kworker.0 00000100:00100000:1.0:1788510347.978565:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510347.978622:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861030016:0@lo:400:kworker.0 00000100:00100000:1.0:1788510347.978665:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510347.978703:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788510347.978710:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861029376:0@lo:400:kworker.0 00000100:00100000:1.0:1788510347.978744:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510347.978794:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861029888:0@lo:400:kworker.0 00000100:00100000:1.0:1788510347.978820:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510347.978859:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861029504 00000100:00100000:1.0:1788510347.978869:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861029504 00000100:00100000:1.0:1788510347.978924:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861029888 00000100:00100000:1.0:1788510347.978928:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861029888 00000100:00100000:1.0:1788510347.978960:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788510347.978969:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861029504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510347.980511:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861029760:0@lo:400:kworker.0 00000100:00100000:0.0:1788510347.980610:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510347.980689:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788510347.980698:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861029632:0@lo:400:kworker.0 00000100:00100000:0.0:1788510347.980725:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510347.980770:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861030016 00000100:00100000:0.0:1788510347.980780:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861030016 00000100:00100000:0.0:1788510347.980849:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861029760 00000100:00100000:0.0:1788510347.980852:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861029760 00000100:00100000:0.0:1788510347.980878:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788510347.980888:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861030016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510347.980946:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861030016:12345-0@lo:400:kworker.0 Request processed in 59us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510347.980953:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788510347.980970:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788510347.980976:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861029760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510347.981030:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861029760:12345-0@lo:400:kworker.0 Request processed in 54us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510347.981048:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788510347.981097:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abae69f80 x1875388861029760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510347.981113:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861029760:0@lo:400:kworker.0 00000100:00100000:1.0:1788510347.981732:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861029504:12345-0@lo:400:kworker.0 Request processed in 55us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510347.981749:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788510347.981773:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861029632 00000100:00100000:1.0:1788510347.981779:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861029632 00000100:00100000:1.0:1788510347.981810:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788510347.981816:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861029888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510347.981867:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861029888:12345-0@lo:400:kworker.0 Request processed in 51us (3045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510347.981872:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788510347.981883:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788510347.981890:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861029632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510347.981919:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861029632:12345-0@lo:400:kworker.0 Request processed in 31us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510347.981924:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788510347.981955:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861029376 00000100:00100000:1.0:1788510347.981959:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861029376 00000100:00100000:1.0:1788510347.981986:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788510347.981992:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861029376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510347.982059:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861029376:12345-0@lo:400:kworker.0 Request processed in 67us (3314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510347.982066:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788510347.982127:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861029376:0@lo:400:kworker.0 00000100:00100000:1.0:1788510347.982144:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861029888:0@lo:400:kworker.0 00000100:00100000:1.0:1788510347.982160:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861029504:0@lo:400:kworker.0 00010000:00080000:1.0:1788510347.982175:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abae6aa00 x1875388861030016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510347.982185:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861030016:0@lo:400:kworker.0 00000100:00100000:0.0:1788510347.983742:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861029632:0@lo:400:kworker.0 00000100:00080000:3.0:1788510347.985068:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788510347.985076:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788510347.985080:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510348.494192:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861030144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510348.495193:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510348.500842:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861030144 00000100:00100000:0.0:1788510348.500863:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861030144 00000100:00100000:0.0:1788510348.500930:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788510348.500943:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861030144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788510348.500986:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510348.501838:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861030144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 896us (6646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510348.501847:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788510348.502088:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaee5ce00 x1875388861030144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510348.502111:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861030144:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788510348.549120:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510349.576689:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510349.923710:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510349.923755:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510349.924407:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852609024 00000100:00100000:3.0:1788510349.924420:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852609024 00000100:00100000:3.0:1788510349.924489:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 198 00000100:00100000:3.0:1788510349.924500:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2340:x1875388852609024:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510349.924581:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2340:x1875388852609024:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 82us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510349.924589:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 198 00000100:00100000:1.0:1788510349.930589:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852609152 00000100:00100000:1.0:1788510349.930620:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852609152 00000100:00100000:1.0:1788510349.930712:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00100000:1.0:1788510349.930723:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852609152:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510349.930813:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852609152:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 91us (7055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510349.930821:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00080000:3.0:1788510349.931027:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788510350.598904:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788510350.760301:0:9319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.4 00000100:00100000:2.0:1788510351.045422:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788510351.045444:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861030272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788510351.045515:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510351.045533:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861030272 00000100:00100000:0.0:1788510351.045541:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861030272 00000100:00100000:0.0:1788510351.045608:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788510351.045618:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861030272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788510351.045654:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510351.045982:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861030272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 364us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510351.045997:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788510351.046018:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788510351.046145:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab50ef100 x1875388861030272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510351.046165:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861030272:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788510351.621803:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510352.644570:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510353.104355:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861030528:0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.104423:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510353.104472:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861031040:0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.104496:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510353.104527:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788510353.104532:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861030400:0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.106238:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510353.106293:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861030912:0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.106332:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510353.106369:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861030656:0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.106408:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510353.106436:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788510353.106442:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861030784:0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.106464:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510353.106505:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861030528 00000100:00100000:3.0:1788510353.106512:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861030528 00000100:00100000:3.0:1788510353.107650:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861030912 00000100:00100000:3.0:1788510353.107661:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861030912 00000100:00100000:3.0:1788510353.107714:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861030656 00000100:00100000:3.0:1788510353.107717:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861030656 00000100:00100000:3.0:1788510353.107736:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788510353.107745:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861030528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.107821:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861030528:12345-0@lo:400:kworker.0 Request processed in 76us (3396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510353.107827:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788510353.107843:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788510353.107849:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861030912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.107876:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861030912:12345-0@lo:400:kworker.0 Request processed in 27us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510353.107881:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788510353.107894:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788510353.107900:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861030656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.107928:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861030656:12345-0@lo:400:kworker.0 Request processed in 29us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510353.107934:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788510353.107955:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861031040 00000100:00100000:3.0:1788510353.107959:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861031040 00000100:00100000:3.0:1788510353.107984:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861030784 00000100:00100000:3.0:1788510353.107987:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861030784 00000100:00100000:3.0:1788510353.108006:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788510353.108012:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861031040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.108041:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861031040:12345-0@lo:400:kworker.0 Request processed in 29us (3544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510353.108054:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788510353.108066:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788510353.108071:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861030784:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788510353.108313:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788510353.108318:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510353.108321:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510353.109709:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861030784:12345-0@lo:400:kworker.0 Request processed in 1631us (3237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510353.109720:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788510353.109753:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861030400 00000100:00100000:3.0:1788510353.109758:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861030400 00000100:00100000:3.0:1788510353.109846:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788510353.109854:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861030400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.109890:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861030400:12345-0@lo:400:kworker.0 Request processed in 38us (3672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510353.109896:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788510353.113208:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861030400:0@lo:400:kworker.0 00000100:00100000:2.0:1788510353.113245:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861030912:0@lo:400:kworker.0 00000100:00100000:2.0:1788510353.113259:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861030528:0@lo:400:kworker.0 00010000:00080000:2.0:1788510353.113275:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a89046680 x1875388861031040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510353.113285:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861031040:0@lo:400:kworker.0 00010000:00080000:3.0:1788510353.121293:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaee5d880 x1875388861030784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510353.121312:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861030784:0@lo:400:kworker.0 00000100:00100000:3.0:1788510353.121327:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861030656:0@lo:400:kworker.0 00000001:02000400:2.0:1788510353.231041:0:9417:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.4 00000100:00100000:2.0:1788510353.604713:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788510353.604739:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861031168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510353.604820:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510353.604946:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861031168 00000100:00100000:3.0:1788510353.604954:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861031168 00000100:00100000:3.0:1788510353.605014:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788510353.605025:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861031168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788510353.605060:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510353.605106:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861031168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510353.605129:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788510353.605169:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaed52680 x1875388861031168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510353.605187:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861031168:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788510353.668580:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510354.695469:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510355.044912:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510355.044962:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510355.045087:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852609408 00000100:00100000:3.0:1788510355.045098:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852609408 00000100:00100000:3.0:1788510355.045183:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 53 00000100:00100000:3.0:1788510355.045195:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2342:x1875388852609408:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510355.045297:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2342:x1875388852609408:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510355.045305:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 53 00000100:00100000:1.0:1788510355.045471:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852609280 00000100:00100000:1.0:1788510355.045476:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852609280 00000100:00100000:1.0:1788510355.045512:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 200 00000100:00100000:1.0:1788510355.045542:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2342:x1875388852609280:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510355.045578:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2342:x1875388852609280:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 38us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510355.045584:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 200 00000100:00080000:2.0:1788510355.047115:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788510355.569993:0:9466:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 04:25:53 EDT 2026 00010000:00010000:3.0:1788510355.720743:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510356.164517:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861031296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788510356.164606:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510356.164809:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861031296 00000100:00100000:2.0:1788510356.164818:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861031296 00000100:00100000:2.0:1788510356.164889:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788510356.164899:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861031296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510356.164938:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510356.164981:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861031296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510356.164987:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788510356.165101:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788510356.165135:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab50edf80 x1875388861031296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510356.165153:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861031296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788510356.744524:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510357.764512:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510358.212500:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510358.212576:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788510358.212609:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861031552:0@lo:400:kworker.0 00000100:00100000:1.0:1788510358.212693:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510358.213131:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861031552 00000100:00100000:0.0:1788510358.213141:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861031552 00000100:00100000:0.0:1788510358.213211:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788510358.213243:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861031552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510358.213308:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861031552:12345-0@lo:400:kworker.0 Request processed in 88us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510358.213314:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788510358.213473:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861031552:0@lo:400:kworker.0 00000100:00100000:2.0:1788510358.213825:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861031424:0@lo:400:kworker.0 00000100:00100000:2.0:1788510358.213865:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510358.213950:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861031424 00000100:00100000:1.0:1788510358.213954:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861031424 00000100:00100000:1.0:1788510358.213992:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788510358.213999:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861031424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510358.214038:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861031424:12345-0@lo:400:kworker.0 Request processed in 40us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510358.214045:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788510358.214091:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861031424:0@lo:400:kworker.0 00000100:00100000:1.0:1788510358.214952:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861031680:0@lo:400:kworker.0 00000100:00100000:1.0:1788510358.214993:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510358.215149:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861031808:0@lo:400:kworker.0 00000100:00100000:0.0:1788510358.215184:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510358.215406:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861031680 00000100:00100000:2.0:1788510358.215414:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861031680 00000100:00100000:2.0:1788510358.215601:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788510358.215612:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861031680:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788510358.215925:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510358.216069:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861031808 00000100:00100000:3.0:1788510358.216074:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861031808 00000100:00100000:3.0:1788510358.216110:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788510358.216117:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861031808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510358.216157:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861031808:12345-0@lo:400:kworker.0 Request processed in 41us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510358.216177:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788510358.216348:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788510358.216388:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaed50e00 x1875388861031808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510358.216405:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861031808:0@lo:400:kworker.0 00000100:00100000:0.0:1788510358.218018:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861031936:0@lo:400:kworker.0 00000100:00100000:0.0:1788510358.218104:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510358.218159:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788510358.218167:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861032064:0@lo:400:kworker.0 00000100:00100000:0.0:1788510358.218192:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510358.218615:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861032064 00000100:00100000:3.0:1788510358.218624:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861032064 00000100:00100000:3.0:1788510358.218888:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788510358.218898:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861032064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510358.218967:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861032064:12345-0@lo:400:kworker.0 Request processed in 70us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510358.218974:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788510358.219003:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788510358.219011:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:3.0:1788510358.219925:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaed51c00 x1875388861032064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510358.219943:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861032064:0@lo:400:kworker.0 00000100:00100000:3.0:1788510358.219991:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861031936 00000100:00100000:3.0:1788510358.219997:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861031936 00000100:00100000:3.0:1788510358.220038:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788510358.220046:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788510358.220128:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861031936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510358.220184:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861031936:12345-0@lo:400:kworker.0 Request processed in 132us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510358.220191:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788510358.220302:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788510358.220307:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788510358.221333:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861031936:0@lo:400:kworker.0 00000100:00100000:2.0:1788510358.221858:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861031680:12345-0@lo:400:kworker.0 Request processed in 6246us (6862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510358.221868:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788510358.223206:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861031680:0@lo:400:kworker.0 00000100:00100000:3.0:1788510358.730436:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861032192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788510358.730534:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510358.733007:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861032192 00000100:00100000:2.0:1788510358.733019:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861032192 00000100:00100000:2.0:1788510358.733112:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788510358.733123:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861032192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788510358.733163:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510358.733273:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861032192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (2738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510358.733281:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788510358.735269:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaed51880 x1875388861032192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510358.735300:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861032192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788510358.789461:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510359.814501:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510360.183594:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510360.183649:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510360.183739:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852609536 00000100:00100000:3.0:1788510360.183749:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852609536 00000100:00100000:3.0:1788510360.183813:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 202 00000100:00100000:3.0:1788510360.183825:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2340:x1875388852609536:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510360.183914:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2340:x1875388852609536:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 91us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510360.183921:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 202 00000100:00100000:0.0:1788510360.184010:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852609664 00000100:00100000:0.0:1788510360.184015:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852609664 00000100:00100000:0.0:1788510360.184074:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 57 00000100:00100000:0.0:1788510360.184083:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852609664:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510360.184118:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852609664:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 37us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510360.184124:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 57 00000100:00080000:3.0:1788510360.184218:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788510360.846376:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510361.285963:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510361.285991:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861032320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510361.286095:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510361.286379:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861032320 00000100:00100000:2.0:1788510361.286390:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861032320 00000100:00100000:2.0:1788510361.286475:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788510361.286486:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861032320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510361.286530:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510361.286581:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861032320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510361.286589:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788510361.286677:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788510361.286724:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab50ece00 x1875388861032320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510361.286746:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861032320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788510361.861978:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510362.887759:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510363.333431:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861032832:0@lo:400:kworker.0 00000100:00100000:3.0:1788510363.333515:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510363.333571:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788510363.333576:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861032704:0@lo:400:kworker.0 00000100:00100000:3.0:1788510363.333597:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510363.333627:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861032832 00000100:00100000:3.0:1788510363.333635:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861032832 00000100:00100000:3.0:1788510363.333682:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788510363.333690:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861032832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510363.333732:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861032832:12345-0@lo:400:kworker.0 Request processed in 43us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510363.333750:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788510363.333770:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861032704 00000100:00100000:3.0:1788510363.333773:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861032704 00000100:00100000:3.0:1788510363.333797:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788510363.333803:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861032704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510363.333827:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861032704:12345-0@lo:400:kworker.0 Request processed in 25us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510363.333833:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788510363.333868:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861032704:0@lo:400:kworker.0 00010000:00080000:3.0:1788510363.333879:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaed51f80 x1875388861032832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510363.333889:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861032832:0@lo:400:kworker.0 00000100:00100000:1.0:1788510363.333976:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861032576:0@lo:400:kworker.0 00000100:00100000:1.0:1788510363.334022:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510363.334047:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861033088:0@lo:400:kworker.0 00000100:00100000:1.0:1788510363.334063:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510363.334084:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788510363.334089:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861032448:0@lo:400:kworker.0 00000100:00100000:1.0:1788510363.334111:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510363.334127:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861032960:0@lo:400:kworker.0 00000100:00100000:1.0:1788510363.334143:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788510363.334165:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788510363.334168:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510363.334175:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861033088 00000100:00100000:1.0:1788510363.334178:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861033088 00000100:00100000:1.0:1788510363.334203:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788510363.334208:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861033088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510363.334254:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861033088:12345-0@lo:400:kworker.0 Request processed in 46us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510363.334260:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788510363.334276:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861032448 00000100:00100000:1.0:1788510363.334279:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861032448 00000100:00100000:1.0:1788510363.334298:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788510363.334303:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861032448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510363.334326:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861032448:12345-0@lo:400:kworker.0 Request processed in 24us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510363.334338:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788510363.334361:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861032576 00000100:00100000:1.0:1788510363.334364:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861032576 00000100:00100000:1.0:1788510363.334392:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861032960 00000100:00100000:1.0:1788510363.334395:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861032960 00000100:00100000:1.0:1788510363.334411:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788510363.334416:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861032576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510363.334439:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861032576:12345-0@lo:400:kworker.0 Request processed in 24us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510363.334444:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788510363.334453:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788510363.334458:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861032960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510363.334476:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861032960:12345-0@lo:400:kworker.0 Request processed in 19us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510363.334481:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788510363.334498:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788510363.334500:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788510363.334515:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861032448:0@lo:400:kworker.0 00000100:00100000:1.0:1788510363.334523:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861032960:0@lo:400:kworker.0 00000100:00100000:1.0:1788510363.334530:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861032576:0@lo:400:kworker.0 00010000:00080000:1.0:1788510363.334538:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaed52a00 x1875388861033088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510363.334547:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861033088:0@lo:400:kworker.0 00000100:00100000:0.0:1788510363.844681:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788510363.844713:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861033216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510363.844808:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510363.845394:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861033216 00000100:00100000:2.0:1788510363.845406:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861033216 00000100:00100000:2.0:1788510363.845468:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788510363.845480:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861033216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788510363.845518:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510363.845584:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861033216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510363.845591:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788510363.845662:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaed51f80 x1875388861033216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510363.845684:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861033216:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788510363.909084:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510364.932595:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510365.292541:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510365.292649:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510365.292896:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852609920 00000100:00100000:0.0:1788510365.292906:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852609920 00000100:00100000:0.0:1788510365.292997:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 61 00000100:00100000:0.0:1788510365.293009:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852609920:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510365.293088:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852609920:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 81us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510365.293095:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 61 00000100:00100000:3.0:1788510365.293404:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852609792 00000100:00100000:3.0:1788510365.293409:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852609792 00000100:00100000:3.0:1788510365.293448:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 204 00000100:00100000:3.0:1788510365.293455:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2341:x1875388852609792:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510365.293482:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2341:x1875388852609792:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 28us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510365.293489:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 204 00000100:00080000:1.0:1788510365.296448:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788510365.956846:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510366.411215:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861033344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788510366.411335:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510366.411502:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861033344 00000100:00100000:2.0:1788510366.411524:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861033344 00000100:00100000:2.0:1788510366.411790:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788510366.411803:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861033344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510366.411851:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510366.411914:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861033344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510366.411923:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788510366.412043:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab50ece00 x1875388861033344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510366.412063:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861033344:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788510366.412179:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788510366.982556:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510368.006986:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510368.452504:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861033600:0@lo:400:kworker.0 00000100:00100000:1.0:1788510368.452575:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861033472:0@lo:400:kworker.0 00000100:00100000:2.0:1788510368.452578:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510368.452621:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510368.452656:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861033600 00000100:00100000:1.0:1788510368.452665:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861033600 00000100:00100000:1.0:1788510368.452718:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788510368.452727:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861033600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510368.452791:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861033600:12345-0@lo:400:kworker.0 Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510368.452799:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788510368.452807:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861033728:0@lo:400:kworker.0 00000100:00100000:1.0:1788510368.452823:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861033472 00000100:00100000:1.0:1788510368.452827:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861033472 00000100:00100000:3.0:1788510368.452834:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510368.452850:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788510368.452854:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510368.452856:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861033472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510368.452859:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861033856:0@lo:400:kworker.0 00000100:00100000:3.0:1788510368.452880:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510368.452883:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861033472:12345-0@lo:400:kworker.0 Request processed in 29us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510368.452889:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788510368.452907:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861033728 00000100:00100000:3.0:1788510368.452910:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861033728 00000100:00100000:1.0:1788510368.452935:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861034112:0@lo:400:kworker.0 00000100:00100000:3.0:1788510368.452941:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788510368.452947:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861033728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510368.452957:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510368.452976:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861033728:12345-0@lo:400:kworker.0 Request processed in 29us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510368.452982:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788510368.453002:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861033856 00000100:00100000:3.0:1788510368.453006:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861033856 00000100:00100000:3.0:1788510368.453030:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861034112 00000100:00100000:3.0:1788510368.453033:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861034112 00000100:00100000:3.0:1788510368.453051:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788510368.453058:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861033856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510368.453097:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861033856:12345-0@lo:400:kworker.0 Request processed in 40us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510368.453103:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788510368.453113:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788510368.453119:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861034112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510368.453143:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861034112:12345-0@lo:400:kworker.0 Request processed in 25us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510368.453149:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788510368.453164:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788510368.453177:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788510368.453180:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510368.453202:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861033984:0@lo:400:kworker.0 00000100:00100000:3.0:1788510368.453250:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510368.453276:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861033472:0@lo:400:kworker.0 00010000:00080000:3.0:1788510368.453319:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaed50000 x1875388861033856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510368.453331:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861033856:0@lo:400:kworker.0 00000100:00100000:3.0:1788510368.453341:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861033728:0@lo:400:kworker.0 00000100:00100000:3.0:1788510368.453356:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861033984 00000100:00100000:3.0:1788510368.453359:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861033984 00000100:00100000:3.0:1788510368.453382:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788510368.453388:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861033984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510368.454649:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861033600:0@lo:400:kworker.0 00000100:00080000:0.0:1788510368.455513:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788510368.456315:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaed52a00 x1875388861034112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510368.456332:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861034112:0@lo:400:kworker.0 00000100:00100000:3.0:1788510368.458821:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861033984:12345-0@lo:400:kworker.0 Request processed in 5424us (5561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510368.458836:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788510368.458906:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861033984:0@lo:400:kworker.0 00000100:00100000:1.0:1788510368.974904:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861034240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788510368.975125:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510368.975208:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861034240 00000100:00100000:1.0:1788510368.975217:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861034240 00000100:00100000:1.0:1788510368.975306:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788510368.975316:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861034240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788510368.975358:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510368.975408:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861034240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510368.975416:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788510368.975468:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd0a80 x1875388861034240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510368.975494:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861034240:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788510369.043890:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510370.052724:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510370.420844:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510370.421043:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510370.424288:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852610176 00000100:00100000:3.0:1788510370.424305:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852610176 00000100:00100000:3.0:1788510370.424411:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 65 00000100:00100000:3.0:1788510370.424422:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852610176:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510370.424517:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852610176:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 97us (3689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510370.424525:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 65 00000100:00080000:1.0:1788510370.428462:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510370.430672:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852610048 00000100:00100000:0.0:1788510370.430687:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852610048 00000100:00100000:0.0:1788510370.430759:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 206 00000100:00100000:0.0:1788510370.430770:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2341:x1875388852610048:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510370.430859:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2341:x1875388852610048:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 90us (9816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510370.430875:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 206 00010000:00010000:2.0:1788510371.077992:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510371.524456:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788510371.524480:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861034368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788510371.524553:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510371.524950:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861034368 00000100:00100000:2.0:1788510371.524960:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861034368 00000100:00100000:2.0:1788510371.525037:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788510371.525048:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861034368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510371.525084:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510371.525136:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861034368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510371.525160:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788510371.525200:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a89046680 x1875388861034368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510371.525218:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861034368:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788510371.525322:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788510372.106652:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788510372.390931:0:10096:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:26:10 (1788510370) === 00000100:00100000:2.0:1788510372.871876:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510372.872170:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852610304 00000100:00100000:3.0:1788510372.872180:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852610304 00000100:00100000:3.0:1788510372.872278:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 207 00000100:00100000:3.0:1788510372.872288:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:8116:x1875388852610304:12345-192.168.201.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788510372.872306:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510372.872324:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81532800/0x3e734462ed65424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73153 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510372.872353:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81532800/0x3e734462ed65424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73153 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510372.872365:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81532800/0x3e734462ed65424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73153 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510372.872375:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81532800, rc 0) 00000100:00100000:3.0:1788510372.872442:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:8116:x1875388852610304:12345-192.168.201.4@tcp:101:mount.lustre.0 Request processed in 155us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510372.872449:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 207 00000100:00100000:3.0:1788510372.880834:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510372.881000:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852610432 00000100:00100000:1.0:1788510372.881013:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852610432 00000100:00100000:1.0:1788510372.881070:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 208 00000100:00100000:1.0:1788510372.881080:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:8116:x1875388852610432:12345-192.168.201.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788510372.881427:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:8116:x1875388852610432:12345-192.168.201.4@tcp:501:mount.lustre.0 Request processed in 346us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510372.881435:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 208 00000100:00100000:1.0:1788510372.889598:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510372.889697:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852610560 00000100:00100000:0.0:1788510372.889708:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852610560 00000100:00100000:0.0:1788510372.889768:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 209 00000100:00100000:0.0:1788510372.889779:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:8116:x1875388852610560:12345-192.168.201.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788510372.890046:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:8116:x1875388852610560:12345-192.168.201.4@tcp:503:mount.lustre.0 Request processed in 268us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510372.890054:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 209 00000100:00100000:2.0:1788510372.900563:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510372.900728:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852610688 00000100:00100000:3.0:1788510372.900739:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852610688 00000100:00100000:3.0:1788510372.900798:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 210 00000100:00100000:3.0:1788510372.900808:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:8120:x1875388852610688:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788510372.901366:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:8120:x1875388852610688:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 556us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510372.901383:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 210 00000100:00100000:3.0:1788510372.918732:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510372.918953:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852610816 00000100:00100000:1.0:1788510372.918966:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852610816 00000100:00100000:1.0:1788510372.919028:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 211 00000100:00100000:1.0:1788510372.919039:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:8120:x1875388852610816:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788510372.921703:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:8120:x1875388852610816:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 2653us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510372.921718:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 211 00000100:00100000:1.0:1788510372.930186:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510372.930539:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852610944 00000100:00100000:3.0:1788510372.930550:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852610944 00000100:00100000:3.0:1788510372.930607:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 212 00000100:00100000:3.0:1788510372.930618:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:8116:x1875388852610944:12345-192.168.201.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788510372.930636:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510372.930657:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81533200/0x3e734462ed6542b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7317d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510372.930688:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81533200/0x3e734462ed6542b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7317d expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510372.930698:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81533200/0x3e734462ed6542b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7317d expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510372.930706:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81533200, rc 0) 00000100:00100000:3.0:1788510372.930775:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:8116:x1875388852610944:12345-192.168.201.4@tcp:101:mount.lustre.0 Request processed in 161us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510372.930781:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 212 00000100:00100000:2.0:1788510372.933414:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510372.933501:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852611072 00000100:00100000:1.0:1788510372.933512:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852611072 00000100:00100000:1.0:1788510372.933569:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 213 00000100:00100000:1.0:1788510372.933579:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:8116:x1875388852611072:12345-192.168.201.4@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788510372.933604:0:5814:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788510372.933627:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788510372.933630:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788510372.933632:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788510372.933634:0:5814:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788510372.934607:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:8116:x1875388852611072:12345-192.168.201.4@tcp:256:mount.lustre.0 Request processed in 1026us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510372.934614:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 213 00000100:00100000:2.0:1788510372.936863:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510372.936955:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852611200 00000100:00100000:0.0:1788510372.936965:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852611200 00000100:00100000:0.0:1788510372.937013:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 214 00000100:00100000:0.0:1788510372.937023:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:8116:x1875388852611200:12345-192.168.201.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788510372.937041:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510372.937058:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eafa00/0x3e734462ed65432 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73184 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510372.937092:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eafa00/0x3e734462ed65432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73184 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510372.937100:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eafa00/0x3e734462ed65432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73184 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510372.937107:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafa00, rc 0) 00000100:00100000:0.0:1788510372.937168:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:8116:x1875388852611200:12345-192.168.201.4@tcp:101:mount.lustre.0 Request processed in 146us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510372.937176:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 214 00000100:00100000:2.0:1788510372.943776:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510372.946777:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852611328 00000100:00100000:1.0:1788510372.946790:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852611328 00000100:00100000:1.0:1788510372.946857:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 215 00000100:00100000:1.0:1788510372.946868:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:8116:x1875388852611328:12345-192.168.201.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788510372.947413:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:8116:x1875388852611328:12345-192.168.201.4@tcp:501:mount.lustre.0 Request processed in 545us (3645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510372.947419:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 215 00000100:00100000:2.0:1788510372.950151:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510372.951746:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852611456 00000100:00100000:0.0:1788510372.951758:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852611456 00000100:00100000:0.0:1788510372.951815:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 216 00000100:00100000:0.0:1788510372.951826:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:8116:x1875388852611456:12345-192.168.201.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788510372.952062:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:8116:x1875388852611456:12345-192.168.201.4@tcp:503:mount.lustre.0 Request processed in 237us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510372.952077:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 216 00000100:00100000:2.0:1788510372.955412:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510372.955921:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852611584 00000100:00100000:1.0:1788510372.955936:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852611584 00000100:00100000:1.0:1788510372.956002:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 217 00000100:00100000:1.0:1788510372.956028:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:8124:x1875388852611584:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788510372.956348:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:8124:x1875388852611584:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 321us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510372.956356:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 217 00000100:00100000:2.0:1788510372.958995:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510372.959133:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852611712 00000100:00100000:0.0:1788510372.959143:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852611712 00000100:00100000:0.0:1788510372.959198:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 218 00000100:00100000:0.0:1788510372.959219:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:8124:x1875388852611712:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788510372.959522:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:8124:x1875388852611712:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 314us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510372.959530:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 218 00000100:00100000:2.0:1788510372.963728:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510372.963773:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510372.963990:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852611840 00000100:00100000:1.0:1788510372.963999:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852611840 00000100:00100000:1.0:1788510372.964050:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852612224 00000100:00100000:1.0:1788510372.964053:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852612224 00000100:00100000:3.0:1788510372.964057:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:3.0:1788510372.964066:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2339:x1875388852611840:12345-192.168.201.4@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788510372.964096:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2cf9f1e0-2527-425a-acbd-f88466347be1@192.168.201.4@tcp t0 exp 0000000000000000 cur 230 last 0 00000100:00100000:1.0:1788510372.964113:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 66 00000100:00100000:1.0:1788510372.964120:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2342:x1875388852612224:12345-192.168.201.4@tcp:400:kworker.0 00000020:00000080:3.0:1788510372.964143:0:5823:0:(genops.c:1385:class_connect()) connect: client 2cf9f1e0-2527-425a-acbd-f88466347be1, cookie 0x3e734462ed65439 00000004:00100000:3.0:1788510372.964172:0:5823:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00100000:1.0:1788510372.964181:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2342:x1875388852612224:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 62us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510372.964187:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 66 00000100:00080000:2.0:1788510372.964347:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788510372.964484:0:5823:0:(import.c:65:import_set_state_nolock()) ffff929abaacb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788510372.964583:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2339:x1875388852611840:12345-192.168.201.4@tcp:38:mount.lustre.0 Request processed in 515us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510372.964591:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:2.0:1788510372.971771:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510372.971830:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510372.971965:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852611968 00000100:00100000:3.0:1788510372.971976:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852611968 00000100:00100000:3.0:1788510372.972059:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852612096 00000100:00100000:3.0:1788510372.972062:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852612096 00000100:00100000:3.0:1788510372.972089:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:3.0:1788510372.972100:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+7:0:x1875388852611968:12345-192.168.201.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788510372.972147:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788510372.972276:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+7:0:x1875388852611968:12345-192.168.201.4@tcp:41:mount.lustre.0 Request processed in 176us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510372.972283:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:3.0:1788510372.972301:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:3.0:1788510372.972308:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+6:8116:x1875388852612096:12345-192.168.201.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788510372.972319:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788510372.972343:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+6:8116:x1875388852612096:12345-192.168.201.4@tcp:41:mount.lustre.0 Request processed in 36us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510372.972349:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00080000:2.0:1788510372.973188:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510372.974415:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510372.974499:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852612352 00000100:00100000:3.0:1788510372.974508:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852612352 00000100:00100000:3.0:1788510372.974566:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:3.0:1788510372.974576:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+6:8116:x1875388852612352:12345-192.168.201.4@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788510372.974658:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+6:8116:x1875388852612352:12345-192.168.201.4@tcp:40:mount.lustre.0 Request processed in 83us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510372.974665:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:3.0:1788510372.977044:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510372.977136:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510372.977172:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510372.977336:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852612480 00000100:00100000:1.0:1788510372.977346:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852612480 00000100:00100000:1.0:1788510372.977386:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852612608 00000100:00100000:1.0:1788510372.977389:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852612608 00000100:00100000:1.0:1788510372.977408:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:1.0:1788510372.977416:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2339:x1875388852612480:12345-192.168.201.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788510372.977446:0:6669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2cf9f1e0-2527-425a-acbd-f88466347be1@192.168.201.4@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1788510372.977478:0:6669:0:(genops.c:1385:class_connect()) connect: client 2cf9f1e0-2527-425a-acbd-f88466347be1, cookie 0x3e734462ed65440 00002000:00100000:1.0:1788510372.977489:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2cf9f1e0-2527-425a-acbd-f88466347be1/ffff929981eae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788510372.977499:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788510372.977730:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788510372.977757:0:6669:0:(import.c:65:import_set_state_nolock()) ffff929981ead800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788510372.977811:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2339:x1875388852612480:12345-192.168.201.4@tcp:8:mount.lustre.0 Request processed in 395us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510372.977835:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:1.0:1788510372.977856:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:1.0:1788510372.977861:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2339:x1875388852612608:12345-192.168.201.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788510372.977878:0:6669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2cf9f1e0-2527-425a-acbd-f88466347be1@192.168.201.4@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1788510372.977894:0:6669:0:(genops.c:1385:class_connect()) connect: client 2cf9f1e0-2527-425a-acbd-f88466347be1, cookie 0x3e734462ed65447 00002000:00100000:1.0:1788510372.977899:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2cf9f1e0-2527-425a-acbd-f88466347be1/ffff929981eac800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788510372.977915:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788510372.978040:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788510372.978056:0:6669:0:(import.c:65:import_set_state_nolock()) ffff929981eae000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788510372.978080:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2339:x1875388852612608:12345-192.168.201.4@tcp:8:mount.lustre.0 Request processed in 217us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510372.978164:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:0.0:1788510372.984424:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852612736 00000100:00100000:0.0:1788510372.984441:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852612736 00000100:00100000:0.0:1788510372.984537:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 1 00000100:00100000:0.0:1788510372.984550:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+6:8116:x1875388852612736:12345-192.168.201.4@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788510372.984643:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788510372.984766:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+6:8116:x1875388852612736:12345-192.168.201.4@tcp:33:mount.lustre.0 Request processed in 218us (7730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510372.984773:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 1 00010000:00010000:2.0:1788510373.124498:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510373.573036:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861034496:0@lo:400:kworker.0 00000100:00100000:1.0:1788510373.573053:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861034624:0@lo:400:kworker.0 00000100:00100000:3.0:1788510373.573157:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861034752:0@lo:400:kworker.0 00000100:00100000:2.0:1788510373.573317:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861034880:0@lo:400:kworker.0 00000100:00100000:1.0:1788510373.584275:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510373.584338:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861035136:0@lo:400:kworker.0 00000100:00100000:1.0:1788510373.584400:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510373.584438:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510373.584445:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861035008:0@lo:400:kworker.0 00000100:00100000:1.0:1788510373.584468:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510373.584519:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861034624 00000100:00100000:1.0:1788510373.584527:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861034624 00000100:00100000:1.0:1788510373.584571:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861035008 00000100:00100000:1.0:1788510373.584575:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861035008 00000100:00100000:1.0:1788510373.584616:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788510373.584625:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861034624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510373.585867:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510373.586789:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788510373.586811:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861035008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510373.586891:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861035008:12345-0@lo:400:kworker.0 Request processed in 91us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510373.586898:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788510373.586962:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861034624:12345-0@lo:400:kworker.0 Request processed in 2336us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510373.586963:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861035008:0@lo:400:kworker.0 00000100:00100000:1.0:1788510373.586969:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788510373.586991:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861034624:0@lo:400:kworker.0 00000100:00100000:1.0:1788510373.586992:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861035136 00000100:00100000:1.0:1788510373.586998:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861035136 00000100:00100000:1.0:1788510373.587034:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788510373.587040:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861035136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510373.587070:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861034496 00000100:00100000:1.0:1788510373.587075:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861035136:12345-0@lo:400:kworker.0 Request processed in 35us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510373.587082:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788510373.587118:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abae64e00 x1875388861035136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510373.587130:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861035136:0@lo:400:kworker.0 00000100:00100000:3.0:1788510373.587191:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788510373.587290:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510373.587296:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510373.587317:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861034752 00000100:00100000:1.0:1788510373.587321:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861034752 00000100:00100000:1.0:1788510373.587359:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788510373.587368:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861034752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510373.587415:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861034752:12345-0@lo:400:kworker.0 Request processed in 48us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510373.587421:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788510373.587434:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510373.587674:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861034496 00000100:00100000:0.0:1788510373.588129:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788510373.588140:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861034496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510373.588248:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861034496:12345-0@lo:400:kworker.0 Request processed in 111us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510373.588255:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788510373.588307:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861034496:0@lo:400:kworker.0 00000100:00100000:2.0:1788510373.588567:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510373.588741:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861034880 00000100:00100000:0.0:1788510373.588748:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861034880 00000100:00100000:0.0:1788510373.588853:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788510373.588862:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861034880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510373.588899:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861034752:0@lo:400:kworker.0 00000100:00100000:0.0:1788510373.588915:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861034880:12345-0@lo:400:kworker.0 Request processed in 54us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510373.588923:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788510373.589027:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abae67800 x1875388861034880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510373.589039:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861034880:0@lo:400:kworker.0 00000100:00080000:1.0:1788510373.589090:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510374.085415:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861035264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510374.085504:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510374.086834:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861035264 00000100:00100000:3.0:1788510374.086847:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861035264 00000100:00100000:3.0:1788510374.086953:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788510374.086964:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861035264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788510374.086991:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510374.087064:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861035264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510374.087072:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788510374.094178:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaed52300 x1875388861035264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510374.094299:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861035264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788510374.150610:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788510374.183840:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2cf9f1e0-2527-425a-acbd-f88466347be1 00000001:00100000:3.0:1788510374.705098:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2cf9f1e0-2527-425a-acbd-f88466347be1 00000001:00100000:1.0:1788510374.707195:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2cf9f1e0-2527-425a-acbd-f88466347be1 00010000:00010000:2.0:1788510375.174382:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510376.196497:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510376.644445:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861035392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788510376.644519:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510376.653256:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861035392 00000100:00100000:0.0:1788510376.653285:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861035392 00000100:00100000:0.0:1788510376.653359:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788510376.653369:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861035392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788510376.653410:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510376.653492:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861035392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (8973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510376.653499:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788510376.653541:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaf3cf100 x1875388861035392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788510376.653690:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510376.653736:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861035392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788510377.221639:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510378.098590:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510378.098624:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510378.098643:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510378.098661:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510378.098681:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510378.098705:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852613120 00000100:00100000:2.0:1788510378.098714:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852613120 00000100:00100000:2.0:1788510378.098782:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852612992 00000100:00100000:2.0:1788510378.098786:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852612992 00000100:00100000:2.0:1788510378.098819:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 70 00000100:00100000:2.0:1788510378.098828:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852613120:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510378.098908:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852613120:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 80us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510378.098916:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 70 00000100:00100000:2.0:1788510378.098936:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 71 00000100:00100000:2.0:1788510378.098943:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852612992:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510378.098968:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852612992:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510378.098974:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 71 00000100:00100000:2.0:1788510378.098993:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852613376 00000100:00100000:2.0:1788510378.098997:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852613376 00000100:00100000:2.0:1788510378.099021:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852613248 00000100:00100000:2.0:1788510378.099023:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852613248 00000100:00100000:2.0:1788510378.099049:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 39 00000100:00100000:2.0:1788510378.099053:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852613376:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510378.099072:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852613376:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 19us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510378.099075:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 39 00000100:00100000:2.0:1788510378.099082:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 40 00000100:00100000:2.0:1788510378.099086:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852613248:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510378.099096:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852613248:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 11us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510378.099099:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 40 00000100:00080000:2.0:1788510378.099108:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788510378.099110:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788510378.099112:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510378.099197:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852612864 00000100:00100000:0.0:1788510378.099202:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852612864 00000100:00100000:0.0:1788510378.099260:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 220 00000100:00100000:0.0:1788510378.099267:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852612864:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510378.099307:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852612864:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 40us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510378.099314:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 220 00010000:00010000:2.0:1788510378.244498:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510378.701647:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861035776:0@lo:400:kworker.0 00000100:00100000:3.0:1788510378.701739:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510378.701814:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788510378.701821:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861035904:0@lo:400:kworker.0 00000100:00100000:3.0:1788510378.701849:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510378.701892:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861035776 00000100:00100000:3.0:1788510378.701903:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861035776 00000100:00100000:3.0:1788510378.701986:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788510378.701997:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861035776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510378.702059:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861035776:12345-0@lo:400:kworker.0 Request processed in 63us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510378.702073:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788510378.702097:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861035904 00000100:00100000:3.0:1788510378.702101:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861035904 00000100:00100000:3.0:1788510378.702155:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788510378.702162:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861035904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510378.702194:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861035904:12345-0@lo:400:kworker.0 Request processed in 32us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510378.702199:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788510378.702215:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788510378.702219:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788510378.702282:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaed53100 x1875388861035904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510378.702296:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861035904:0@lo:400:kworker.0 00000100:00100000:3.0:1788510378.702307:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861035776:0@lo:400:kworker.0 00000100:00100000:2.0:1788510378.702396:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861035648:0@lo:400:kworker.0 00000100:00100000:2.0:1788510378.702428:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510378.702456:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861036160:0@lo:400:kworker.0 00000100:00100000:2.0:1788510378.702481:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510378.702505:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788510378.702512:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861035520:0@lo:400:kworker.0 00000100:00100000:2.0:1788510378.702538:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510378.702561:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861036032:0@lo:400:kworker.0 00000100:00100000:2.0:1788510378.702582:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510378.702608:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861036160 00000100:00100000:2.0:1788510378.702612:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861036160 00000100:00100000:2.0:1788510378.702655:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788510378.702662:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaefebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861036160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510378.702698:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaefebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861036160:12345-0@lo:400:kworker.0 Request processed in 36us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510378.702704:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788510378.702860:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861035520 00000100:00100000:2.0:1788510378.702864:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861035520 00000100:00100000:2.0:1788510378.702887:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788510378.702893:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861035520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510378.702921:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861035520:12345-0@lo:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510378.702927:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788510378.702950:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861035648 00000100:00100000:2.0:1788510378.702953:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861035648 00000100:00100000:2.0:1788510378.702973:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861036032 00000100:00100000:2.0:1788510378.702975:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861036032 00000100:00100000:2.0:1788510378.702993:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788510378.702999:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861035648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510378.703029:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861035648:12345-0@lo:400:kworker.0 Request processed in 30us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510378.703036:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788510378.703046:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788510378.703052:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861036032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510378.703079:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861036032:12345-0@lo:400:kworker.0 Request processed in 27us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510378.703085:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788510378.703123:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788510378.703135:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788510378.703159:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861035520:0@lo:400:kworker.0 00000100:00100000:2.0:1788510378.703171:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861036032:0@lo:400:kworker.0 00000100:00100000:2.0:1788510378.703181:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861035648:0@lo:400:kworker.0 00010000:00080000:2.0:1788510378.703194:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d31880 x1875388861036160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510378.703204:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861036160:0@lo:400:kworker.0 00000100:00100000:3.0:1788510379.205888:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861036288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788510379.205959:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510379.206186:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861036288 00000100:00100000:0.0:1788510379.206194:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861036288 00000100:00100000:0.0:1788510379.206435:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788510379.206442:0:6671:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788510379.206446:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861036288:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788510379.206452:0:6671:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1788510379.206496:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510379.206563:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861036288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510379.206570:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788510379.207924:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d31f80 x1875388861036288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510379.207955:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861036288:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788510379.255619:0:10295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788510379.268487:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510380.298565:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510381.321857:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510381.764678:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788510381.764706:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861036416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788510381.764780:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510381.765788:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861036416 00000100:00100000:1.0:1788510381.765801:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861036416 00000100:00100000:1.0:1788510381.766043:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788510381.766072:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861036416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788510381.766132:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510381.766308:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861036416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 250us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510381.766318:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788510381.766849:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaf3ced80 x1875388861036416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510381.766873:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861036416:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788510381.769506:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788510382.340801:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510383.204789:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510383.204841:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510383.204969:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852613632 00000100:00100000:1.0:1788510383.204978:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852613632 00000100:00100000:1.0:1788510383.205060:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 75 00000100:00100000:1.0:1788510383.205072:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852613632:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510383.205174:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852613632:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 103us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510383.205183:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 75 00000100:00080000:0.0:1788510383.205263:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510383.205968:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852613888 00000100:00100000:3.0:1788510383.205977:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852613888 00000100:00100000:2.0:1788510383.206100:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510383.206137:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510383.206163:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510383.206195:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852613760 00000100:00100000:2.0:1788510383.206200:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852613760 00000100:00100000:1.0:1788510383.206251:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852613504 00000100:00100000:1.0:1788510383.206255:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852613504 00000100:00100000:1.0:1788510383.206292:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 222 00000100:00100000:1.0:1788510383.206301:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852613504:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510383.206351:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852613504:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 51us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510383.206358:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 222 00000100:00100000:3.0:1788510383.206659:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852614016 00000100:00100000:3.0:1788510383.206663:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852614016 00000100:00080000:0.0:1788510383.207035:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788510383.207042:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788510383.207044:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510383.207128:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 43 00000100:00100000:1.0:1788510383.207143:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852613888:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510383.207217:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852613888:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 80us (2373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510383.207261:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 43 00000100:00100000:2.0:1788510383.207622:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 76 00000100:00100000:2.0:1788510383.207632:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852613760:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510383.207679:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852613760:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 48us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510383.207685:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 76 00000100:00100000:3.0:1788510383.208135:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 44 00000100:00100000:3.0:1788510383.208146:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852614016:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510383.208201:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852614016:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 57us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510383.208208:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 44 00010000:00010000:2.0:1788510383.364530:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510383.812543:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861036544:0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.812623:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510383.812679:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861037056:0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.812708:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510383.812739:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788510383.812745:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861036672:0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.812766:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510383.812784:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861037184:0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.812814:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510383.812842:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861036800:0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.812864:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510383.812882:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788510383.812888:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861036928:0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.812950:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510383.812988:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861037056 00000100:00100000:0.0:1788510383.812997:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861037056 00000100:00100000:0.0:1788510383.813062:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861036672 00000100:00100000:0.0:1788510383.813066:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861036672 00000100:00100000:0.0:1788510383.813078:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861036800 00000100:00100000:0.0:1788510383.813080:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861036800 00000100:00100000:0.0:1788510383.813097:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788510383.813105:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861037056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.813156:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861037056:12345-0@lo:400:kworker.0 Request processed in 51us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510383.813164:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788510383.813179:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788510383.813185:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861036672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.813209:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861036672:12345-0@lo:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510383.813215:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788510383.813265:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788510383.813271:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861036800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.813300:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861036800:12345-0@lo:400:kworker.0 Request processed in 30us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510383.813306:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788510383.813326:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861037184 00000100:00100000:0.0:1788510383.813329:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861037184 00000100:00100000:0.0:1788510383.813352:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861036928 00000100:00100000:0.0:1788510383.813355:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861036928 00000100:00100000:0.0:1788510383.813374:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788510383.813380:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861037184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.813416:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861037184:12345-0@lo:400:kworker.0 Request processed in 36us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510383.813422:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788510383.813432:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788510383.813437:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861036928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.813459:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861036928:12345-0@lo:400:kworker.0 Request processed in 22us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510383.813465:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788510383.813481:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788510383.813484:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788510383.813486:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510383.813514:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861036672:0@lo:400:kworker.0 00010000:00080000:0.0:1788510383.813527:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaf3cce00 x1875388861037184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510383.813536:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861037184:0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.813544:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861037056:0@lo:400:kworker.0 00010000:00080000:0.0:1788510383.813569:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaf3cf480 x1875388861036928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510383.813577:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861036928:0@lo:400:kworker.0 00000100:00100000:0.0:1788510383.813584:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861036800:0@lo:400:kworker.0 00000100:00100000:2.0:1788510383.814141:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861036544 00000100:00100000:2.0:1788510383.814149:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861036544 00000100:00100000:2.0:1788510383.814185:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788510383.814201:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861036544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510383.814264:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861036544:12345-0@lo:400:kworker.0 Request processed in 64us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510383.814270:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788510383.815377:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861036544:0@lo:400:kworker.0 00000100:00100000:3.0:1788510384.325842:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788510384.325864:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861037312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788510384.325935:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510384.326258:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861037312 00000100:00100000:1.0:1788510384.326267:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861037312 00000100:00100000:1.0:1788510384.326310:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788510384.326319:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861037312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788510384.326355:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510384.326408:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861037312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510384.326416:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788510384.326580:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d32a00 x1875388861037312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510384.326604:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861037312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788510384.389081:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510385.412726:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510386.440743:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510386.891481:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861037440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788510386.891596:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510386.891934:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861037440 00000100:00100000:2.0:1788510386.891948:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861037440 00000100:00100000:2.0:1788510386.892036:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788510386.892050:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861037440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510386.892100:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510386.892178:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861037440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510386.892186:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788510386.893308:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788510386.893355:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaf3cd880 x1875388861037440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510386.893379:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861037440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788510387.460490:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510388.338038:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510388.338136:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510388.338164:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510388.338182:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510388.338218:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510388.338265:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852614400 00000100:00100000:0.0:1788510388.338274:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852614400 00000100:00100000:0.0:1788510388.338329:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852614272 00000100:00100000:0.0:1788510388.338332:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852614272 00000100:00100000:0.0:1788510388.338354:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 80 00000100:00100000:0.0:1788510388.338363:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852614400:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510388.339693:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852614400:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 1321us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510388.339717:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 80 00000100:00100000:0.0:1788510388.339756:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 81 00000100:00100000:0.0:1788510388.339769:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852614272:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510388.339823:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852614272:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 61us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510388.339830:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 81 00000100:00100000:0.0:1788510388.339856:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852614656 00000100:00100000:0.0:1788510388.339861:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852614656 00000100:00100000:0.0:1788510388.339895:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852614528 00000100:00100000:0.0:1788510388.339897:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852614528 00000100:00100000:0.0:1788510388.339933:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 47 00000100:00100000:0.0:1788510388.339950:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852614656:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510388.339978:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852614656:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 39us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510388.339985:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 47 00000100:00100000:0.0:1788510388.339996:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 48 00000100:00100000:0.0:1788510388.340002:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852614528:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510388.340024:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852614528:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 22us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510388.340029:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 48 00000100:00080000:0.0:1788510388.340054:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788510388.340059:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788510388.340063:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510388.340634:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852614144 00000100:00100000:3.0:1788510388.340641:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852614144 00000100:00100000:3.0:1788510388.344188:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 224 00000100:00100000:3.0:1788510388.344212:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852614144:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510388.344339:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852614144:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 137us (6313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510388.344347:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 224 00010000:00010000:2.0:1788510388.486432:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510388.933205:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861037696:0@lo:400:kworker.0 00000100:00100000:1.0:1788510388.933306:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510388.933359:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861038208:0@lo:400:kworker.0 00000100:00100000:1.0:1788510388.933387:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510388.933416:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788510388.933421:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861037568:0@lo:400:kworker.0 00000100:00100000:1.0:1788510388.933448:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510388.933470:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861038080:0@lo:400:kworker.0 00000100:00100000:1.0:1788510388.933488:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510388.933516:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861037568 00000100:00100000:1.0:1788510388.933525:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861037568 00000100:00100000:1.0:1788510388.933570:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788510388.933581:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861037568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510388.933629:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861037568:12345-0@lo:400:kworker.0 Request processed in 50us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510388.933653:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788510388.933706:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861037568:0@lo:400:kworker.0 00000100:00100000:0.0:1788510388.934012:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861037824:0@lo:400:kworker.0 00000100:00100000:0.0:1788510388.934046:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510388.934086:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788510388.934093:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861037952:0@lo:400:kworker.0 00000100:00100000:0.0:1788510388.934116:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510388.934146:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861037696 00000100:00100000:0.0:1788510388.934150:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861037696 00000100:00100000:0.0:1788510388.934178:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861038080 00000100:00100000:0.0:1788510388.934181:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861038080 00000100:00100000:0.0:1788510388.934202:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861037824 00000100:00100000:0.0:1788510388.934205:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861037824 00000100:00100000:0.0:1788510388.934219:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788510388.934249:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861037696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510388.934291:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861037696:12345-0@lo:400:kworker.0 Request processed in 42us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510388.934306:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788510388.934320:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788510388.934326:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861038080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510388.934352:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861038080:12345-0@lo:400:kworker.0 Request processed in 27us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510388.934357:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788510388.934366:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788510388.934371:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861037824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510388.934399:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861037824:12345-0@lo:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510388.934403:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788510388.934419:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861038208 00000100:00100000:0.0:1788510388.934423:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861038208 00000100:00100000:0.0:1788510388.934445:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861037952 00000100:00100000:0.0:1788510388.934448:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861037952 00000100:00100000:0.0:1788510388.934465:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788510388.934470:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861038208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510388.934498:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861038208:12345-0@lo:400:kworker.0 Request processed in 27us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510388.934503:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788510388.934513:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788510388.934518:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861037952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510388.934544:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861037952:12345-0@lo:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510388.934549:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788510388.934606:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788510388.934610:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788510388.934612:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788510388.934656:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d35180 x1875388861037952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510388.934668:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861037952:0@lo:400:kworker.0 00000100:00100000:0.0:1788510388.934678:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861037824:0@lo:400:kworker.0 00000100:00100000:0.0:1788510388.934703:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861038080:0@lo:400:kworker.0 00000100:00100000:0.0:1788510388.934712:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861037696:0@lo:400:kworker.0 00010000:00080000:0.0:1788510388.934721:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d34000 x1875388861038208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510388.934730:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861038208:0@lo:400:kworker.0 00000100:00100000:0.0:1788510389.444538:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861038336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510389.444621:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510389.447869:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861038336 00000100:00100000:2.0:1788510389.447886:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861038336 00000100:00100000:2.0:1788510389.448179:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788510389.448196:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861038336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788510389.448269:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510389.448507:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861038336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 315us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510389.448515:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788510389.452292:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d32a00 x1875388861038336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510389.452327:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861038336:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788510389.511423:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510390.533002:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510391.556805:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510392.004531:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861038464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788510392.004614:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510392.004737:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861038464 00000100:00100000:2.0:1788510392.004746:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861038464 00000100:00100000:2.0:1788510392.004811:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788510392.004821:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861038464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510392.004862:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510392.004934:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861038464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510392.004940:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788510392.004983:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaf3cdc00 x1875388861038464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510392.005000:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861038464:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788510392.005118:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788510392.581294:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510393.451924:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510393.451961:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510393.451998:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510393.452019:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510393.452181:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510393.452212:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852614784 00000100:00100000:0.0:1788510393.452249:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852614784 00000100:00100000:0.0:1788510393.452301:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 226 00000100:00100000:0.0:1788510393.452312:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2343:x1875388852614784:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510393.452385:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2343:x1875388852614784:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 75us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510393.452392:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 226 00000100:00100000:0.0:1788510393.452423:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852615040 00000100:00100000:0.0:1788510393.452427:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852615040 00000100:00100000:0.0:1788510393.452459:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852614912 00000100:00100000:0.0:1788510393.452462:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852614912 00000100:00100000:0.0:1788510393.452484:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 85 00000100:00100000:0.0:1788510393.452490:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2343:x1875388852615040:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510393.452519:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2343:x1875388852615040:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 30us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510393.452526:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 85 00000100:00100000:0.0:1788510393.452537:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 86 00000100:00100000:0.0:1788510393.452544:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2343:x1875388852614912:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510393.452568:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2343:x1875388852614912:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510393.452574:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 86 00000100:00100000:0.0:1788510393.452594:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852615168 00000100:00100000:0.0:1788510393.452597:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852615168 00000100:00100000:0.0:1788510393.452623:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852615296 00000100:00100000:0.0:1788510393.452626:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852615296 00000100:00100000:0.0:1788510393.452643:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:0.0:1788510393.452658:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2339:x1875388852615168:12345-192.168.201.4@tcp:9:kworker.0 00000020:00000080:0.0:1788510393.452680:0:6670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65440 00000100:00080000:0.0:1788510393.452691:0:6670:0:(import.c:65:import_set_state_nolock()) ffff929981ead800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788510393.452743:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788510393.454548:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788510393.455194:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788510393.455202:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788510393.455205:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510393.455397:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:2.0:1788510393.455412:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2339:x1875388852615296:12345-192.168.201.4@tcp:9:kworker.0 00000020:00000080:2.0:1788510393.455439:0:6669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65447 00000100:00080000:2.0:1788510393.455449:0:6669:0:(import.c:65:import_set_state_nolock()) ffff929981eae000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788510393.455499:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788510393.455833:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+2:2339:x1875388852615296:12345-192.168.201.4@tcp:9:kworker.0 Request processed in 426us (3650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510393.455841:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 15 00010000:00010000:1.0:1788510393.457903:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510393.458340:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+2:2339:x1875388852615168:12345-192.168.201.4@tcp:9:kworker.0 Request processed in 5673us (6310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510393.458354:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 14 00010000:00010000:2.0:1788510393.605056:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510394.056260:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861038592:0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.056328:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510394.056366:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861039104:0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.056397:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510394.056423:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788510394.056427:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861038720:0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.056442:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510394.056452:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861039232:0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.056479:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510394.056497:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861038976:0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.056510:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510394.056521:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788510394.056524:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861038848:0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.056547:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510394.057011:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861039104 00000100:00100000:2.0:1788510394.057019:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861039104 00000100:00100000:2.0:1788510394.057082:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861038720 00000100:00100000:2.0:1788510394.057086:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861038720 00000100:00100000:2.0:1788510394.057101:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861038848 00000100:00100000:2.0:1788510394.057103:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861038848 00000100:00100000:2.0:1788510394.057119:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788510394.057128:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861039104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.057188:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861039104:12345-0@lo:400:kworker.0 Request processed in 60us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510394.057195:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788510394.057212:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788510394.057217:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861038720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.057265:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861038720:12345-0@lo:400:kworker.0 Request processed in 48us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510394.057271:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788510394.057281:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788510394.057287:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861038848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.057320:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861038848:12345-0@lo:400:kworker.0 Request processed in 33us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510394.057325:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788510394.057359:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861039232 00000100:00100000:2.0:1788510394.057363:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861039232 00000100:00100000:2.0:1788510394.057383:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861038976 00000100:00100000:2.0:1788510394.057384:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861038976 00000100:00100000:2.0:1788510394.057395:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788510394.057399:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861039232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.057421:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861039232:12345-0@lo:400:kworker.0 Request processed in 22us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510394.057425:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788510394.057431:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788510394.057434:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861038976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.057447:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861038976:12345-0@lo:400:kworker.0 Request processed in 13us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510394.057450:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788510394.057465:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788510394.057467:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788510394.057469:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510394.057494:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861038848:0@lo:400:kworker.0 00010000:00080000:2.0:1788510394.057503:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaf3ce300 x1875388861038976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510394.057510:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861038976:0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.057766:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861038720:0@lo:400:kworker.0 00010000:00080000:2.0:1788510394.057778:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaf3cf800 x1875388861039232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510394.057785:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861039232:0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.057800:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861039104:0@lo:400:kworker.0 00000100:00100000:1.0:1788510394.058207:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861038592 00000100:00100000:1.0:1788510394.058214:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861038592 00000100:00100000:1.0:1788510394.058281:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788510394.058289:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861038592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510394.058340:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861038592:12345-0@lo:400:kworker.0 Request processed in 51us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510394.058346:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788510394.058386:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861038592:0@lo:400:kworker.0 00000100:00100000:2.0:1788510394.569106:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861039360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510394.569198:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510394.569370:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861039360 00000100:00100000:3.0:1788510394.569380:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861039360 00000100:00100000:3.0:1788510394.569448:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788510394.569460:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861039360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788510394.569506:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510394.569565:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861039360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510394.569573:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788510394.570363:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d31180 x1875388861039360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510394.570388:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861039360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788510394.635257:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788510394.683973:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2cf9f1e0-2527-425a-acbd-f88466347be1 00000020:00000080:3.0:1788510394.683985:0:6692:0:(genops.c:885:class_export_put()) final put ffff929981eae800/2cf9f1e0-2527-425a-acbd-f88466347be1 00000020:00000080:0.0:1788510394.684176:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff929981eae800/2cf9f1e0-2527-425a-acbd-f88466347be1 for lustre-OST0000 00000020:00000080:0.0:1788510394.684246:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929981ead800 for lustre-OST0000 00000001:00100000:0.0:1788510395.162812:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2cf9f1e0-2527-425a-acbd-f88466347be1 00000020:00000080:0.0:1788510395.162832:0:7621:0:(genops.c:885:class_export_put()) final put ffff929981eac800/2cf9f1e0-2527-425a-acbd-f88466347be1 00000020:00000080:1.0:1788510395.162890:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929981eac800/2cf9f1e0-2527-425a-acbd-f88466347be1 for lustre-OST0001 00000020:00000080:1.0:1788510395.162968:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929981eae000 for lustre-OST0001 00010000:00010000:2.0:1788510395.653419:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510396.676541:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510397.125980:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788510397.126005:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861039488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788510397.126082:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510397.126130:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861039488 00000100:00100000:3.0:1788510397.126139:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861039488 00000100:00080000:2.0:1788510397.126192:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788510397.126203:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788510397.126213:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861039488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788510397.126282:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510397.126325:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861039488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510397.126332:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788510397.126431:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab4e98e00 x1875388861039488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510397.126450:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861039488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788510397.700678:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510398.568708:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510398.568744:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510398.568780:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510398.568806:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852615680 00000100:00100000:0.0:1788510398.568815:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852615680 00000100:00100000:0.0:1788510398.568869:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852615552 00000100:00100000:0.0:1788510398.568872:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852615552 00000100:00100000:0.0:1788510398.568895:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 90 00000100:00100000:0.0:1788510398.568904:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852615680:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510398.568972:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852615680:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 69us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510398.568979:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 90 00000100:00100000:0.0:1788510398.568995:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 91 00000100:00100000:0.0:1788510398.569000:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852615552:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510398.569020:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852615552:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 20us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510398.569034:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 91 00000100:00080000:0.0:1788510398.569052:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510398.569361:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852615424 00000100:00100000:3.0:1788510398.569366:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852615424 00000100:00100000:3.0:1788510398.585049:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 228 00000100:00100000:3.0:1788510398.585072:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2340:x1875388852615424:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510398.585181:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2340:x1875388852615424:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 118us (16482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510398.585189:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 228 00010000:00010000:1.0:1788510398.727661:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788510399.143817:0:10998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788510399.174380:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861040000:0@lo:400:kworker.0 00000100:00100000:3.0:1788510399.174705:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510399.174770:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788510399.174778:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861039872:0@lo:400:kworker.0 00000100:00100000:2.0:1788510399.174791:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861039744:0@lo:400:kworker.0 00000100:00100000:3.0:1788510399.174803:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510399.174832:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861040000 00000100:00100000:2.0:1788510399.174839:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861040000 00000100:00100000:3.0:1788510399.174841:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861039872 00000100:00100000:3.0:1788510399.174851:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861039872 00000100:00100000:3.0:1788510399.174891:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788510399.174891:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788510399.174899:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861039872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510399.174911:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861040000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510399.175000:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861039616:0@lo:400:kworker.0 00000100:00100000:2.0:1788510399.175033:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861040000:12345-0@lo:400:kworker.0 Request processed in 134us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510399.175040:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788510399.175060:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788510399.175071:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510399.179152:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510399.179255:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861040128:0@lo:400:kworker.0 00000100:00100000:1.0:1788510399.179298:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510399.179362:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861040128 00000100:00100000:1.0:1788510399.179373:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861040128 00000100:00100000:1.0:1788510399.179451:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788510399.179459:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861040128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510399.179514:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861040128:12345-0@lo:400:kworker.0 Request processed in 54us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510399.179520:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788510399.179544:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510399.179571:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861040128:0@lo:400:kworker.0 00000100:00100000:3.0:1788510399.181726:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861039872:12345-0@lo:400:kworker.0 Request processed in 6815us (6910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510399.181746:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788510399.181860:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861039872:0@lo:400:kworker.0 00010000:00080000:3.0:1788510399.181877:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d33b80 x1875388861040000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510399.181888:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861040000:0@lo:400:kworker.0 00000100:00100000:3.0:1788510399.181939:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861039616 00000100:00100000:3.0:1788510399.181946:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861039616 00000100:00100000:3.0:1788510399.182922:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788510399.182936:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861039616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510399.183028:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861039616:12345-0@lo:400:kworker.0 Request processed in 96us (3885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510399.183035:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788510399.185075:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510399.185716:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861039616:0@lo:400:kworker.0 00000100:00100000:3.0:1788510399.194578:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861040256:0@lo:400:kworker.0 00000100:00100000:3.0:1788510399.194686:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510399.194784:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861039744 00000100:00100000:3.0:1788510399.194793:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861039744 00000100:00100000:3.0:1788510399.194841:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788510399.194850:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861039744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510399.194913:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861039744:12345-0@lo:400:kworker.0 Request processed in 64us (9847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510399.194933:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788510399.194988:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861039744:0@lo:400:kworker.0 00000100:00100000:0.0:1788510399.195064:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861040256 00000100:00100000:0.0:1788510399.195068:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861040256 00000100:00100000:0.0:1788510399.195184:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788510399.195193:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861040256:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788510399.195523:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788510399.195790:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861040256:12345-0@lo:400:kworker.0 Request processed in 597us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510399.195799:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788510399.196047:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d32680 x1875388861040256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510399.196061:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861040256:0@lo:400:kworker.0 00000100:00100000:2.0:1788510399.684559:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861040384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510399.684630:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510399.684799:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861040384 00000100:00100000:1.0:1788510399.684807:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861040384 00000100:00100000:1.0:1788510399.684862:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788510399.684874:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861040384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788510399.684925:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510399.687770:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861040384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2888us (3127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510399.687784:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788510399.687871:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d32680 x1875388861040384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510399.687896:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861040384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788510399.748529:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510400.777908:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510401.797490:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510402.244435:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788510402.244459:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861040512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788510402.244530:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510402.244611:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861040512 00000100:00100000:3.0:1788510402.244621:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861040512 00000100:00100000:3.0:1788510402.244694:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788510402.244695:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788510402.244732:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861040512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788510402.244773:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510402.245049:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861040512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 317us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510402.245057:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788510402.245196:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaf3cf480 x1875388861040512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510402.245249:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861040512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788510402.827955:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788510403.214842:0:11146:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5ae5fa40 20000000:00000080:3.0:1788510403.214860:0:11146:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff929ab7c61800 uarg=0000000000000000 20000000:01000000:3.0:1788510403.214893:0:11146:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788510403.214898:0:11146:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788510403.214903:0:11146:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788510403.218272:0:11147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788510403.218452:0:11146:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788510403.226512:0:11146:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788510403.226547:0:11146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.226779:0:11146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a813fc400/0x3e734462ed653fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed653f3 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.226787:0:11146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a813fd000/0x3e734462ed65408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65401 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.226807:0:11146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a80031a00/0x3e734462ed65416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6540f expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.226816:0:11146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a80030a00/0x3e734462ed6541d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7314c expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.226823:0:11146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a90eafa00/0x3e734462ed65432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73184 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.226829:0:11146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.226873:0:11146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a90eafa00/0x3e734462ed65432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73184 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.226888:0:11146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a90eafa00/0x3e734462ed65432 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73184 expref: 12 pid: 5815 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510403.226903:0:11146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d36680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875388861040640:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510403.227055:0:11146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a80030a00/0x3e734462ed6541d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7314c expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.227063:0:11146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a80030a00/0x3e734462ed6541d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7314c expref: 12 pid: 5815 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510403.227072:0:11146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875388861040768:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510403.227103:0:11146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a80031a00/0x3e734462ed65416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6540f expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.227121:0:11146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a80031a00/0x3e734462ed65416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6540f expref: 18 pid: 5816 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510403.227131:0:11146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875388861040896:0@lo:104: 00000100:00100000:1.0:1788510403.227171:0:11146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510403.227314:0:7609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861040896 00000100:00100000:2.0:1788510403.227378:0:7609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861040896 00000100:00100000:2.0:1788510403.227434:0:7609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788510403.227444:0:7609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+3:11146:x1875388861040896:12345-0@lo:104: 00010000:00010000:2.0:1788510403.227456:0:7609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510403.227510:0:7609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788510403.227516:0:7609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+3:11146:x1875388861040896:12345-0@lo:104: Request processed in 75us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510403.227523:0:7609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1788510403.227573:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510403.227580:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510403.227587:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc800 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510403.227597:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510403.227606:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510403.227613:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510403.227618:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788510403.227650:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510403.227658:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510403.227688:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510403.227696:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a813fc800/0x3e734462ed6540f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65416 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510403.227707:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510403.227709:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510403.227710:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861041024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788510403.227711:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510403.227744:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788510403.228591:0:11146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a813fd000/0x3e734462ed65408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed65401 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.228602:0:11146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a813fd000/0x3e734462ed65408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed65401 expref: 18 pid: 5815 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510403.228612:0:11146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875388861041152:0@lo:104: 00000100:00100000:1.0:1788510403.228644:0:11146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788510403.228676:0:11146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a813fc400/0x3e734462ed653fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed653f3 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.228694:0:11146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a813fc400/0x3e734462ed653fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed653f3 expref: 18 pid: 5814 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510403.228703:0:11146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875388861041280:0@lo:104: 00000100:00100000:1.0:1788510403.228725:0:11146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510403.228739:0:11146:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884b9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788510403.228758:0:11146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875388861040896:0@lo:104: 00000100:00100000:0.0:1788510403.229435:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861041152 00000100:00100000:0.0:1788510403.229443:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861041152 00000100:00100000:0.0:1788510403.229489:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861041280 00000100:00100000:0.0:1788510403.229493:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861041280 00000100:00100000:0.0:1788510403.229508:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788510403.229516:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+4:11146:x1875388861041152:12345-0@lo:104: 00010000:00010000:0.0:1788510403.229530:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510403.229827:0:7609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788510403.229837:0:7609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+4:11146:x1875388861041280:12345-0@lo:104: 00010000:00010000:2.0:1788510403.229845:0:7609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510403.229904:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788510403.229910:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:040cea51-0882-49ef-ac64-3cc6497ba05a+4:11146:x1875388861041152:12345-0@lo:104: Request processed in 394us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510403.229916:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788510403.229986:0:11146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875388861041152:0@lo:104: 00000100:00100000:1.0:1788510403.229995:0:11146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875388861041280:0@lo:104: 00010000:00010000:2.0:1788510403.231170:0:7609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788510403.231187:0:7609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+3:11146:x1875388861041280:12345-0@lo:104: Request processed in 1349us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510403.231196:0:7609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788510403.231334:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788510403.231342:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.231368:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fcc00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510403.231372:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.231381:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510403.231388:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510403.231394:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788510403.231443:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.231450:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510403.231473:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.231480:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a813fcc00/0x3e734462ed65401 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65408 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.231494:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510403.231497:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.231503:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80030c00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510403.231505:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.231522:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510403.231529:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510403.231534:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788510403.231547:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.231552:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510403.231567:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.231573:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a80030c00/0x3e734462ed653f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed653fa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.231587:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510403.231589:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510403.231591:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510403.231600:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788510403.231614:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861041536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510403.231675:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510403.231967:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788510403.231978:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861041408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788510403.232005:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510403.232472:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861041024 00000100:00100000:1.0:1788510403.232481:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861041024 00010000:00010000:1.0:1788510403.232517:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a80031a00/0x3e734462ed65416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6540f expref: 19 pid: 5816 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510403.232538:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861041536 00000100:00100000:1.0:1788510403.232541:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861041536 00010000:00010000:1.0:1788510403.232564:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a813fc400/0x3e734462ed653fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed653f3 expref: 20 pid: 5814 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510403.232575:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861041408 00000100:00100000:1.0:1788510403.232578:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861041408 00010000:00010000:1.0:1788510403.232587:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a813fd000/0x3e734462ed65408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65401 expref: 21 pid: 5815 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510403.232600:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788510403.232607:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87752450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+21:3290:x1875388861041024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510403.232618:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510403.232623:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a80031a00/0x3e734462ed65416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6540f expref: 21 pid: 5816 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.232633:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a80031a00/0x3e734462ed65416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6540f expref: 21 pid: 5816 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.232647:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80031a00/0x3e734462ed65416 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6540f expref: 21 pid: 5816 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.232662:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510403.232719:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87752450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+20:3290:x1875388861041024:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (4974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510403.232726:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788510403.232771:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788510403.232777:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861041536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510403.232784:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510403.232788:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a813fc400/0x3e734462ed653fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed653f3 expref: 19 pid: 5814 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.232805:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a813fc400/0x3e734462ed653fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed653f3 expref: 19 pid: 5814 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.232816:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fc400/0x3e734462ed653fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed653f3 expref: 19 pid: 5814 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.232825:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510403.232856:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:3289:x1875388861041536:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510403.232862:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788510403.232875:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788510403.232881:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:3290:x1875388861041408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510403.232888:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510403.232892:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a813fd000/0x3e734462ed65408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65401 expref: 17 pid: 5815 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.232899:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a813fd000/0x3e734462ed65408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed65401 expref: 17 pid: 5815 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.232908:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fd000/0x3e734462ed65408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed65401 expref: 17 pid: 5815 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.232917:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510403.232938:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3290:x1875388861041408:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510403.232944:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788510403.232983:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861041536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788510403.233048:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861041408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788510403.233057:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861041024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788510403.234569:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510403.236545:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510403.236560:0:11146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d36680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875388861040640:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510403.236590:0:11146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875388861040768:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510403.236622:0:11146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510403.236673:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510403.237168:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852615808 00000100:00100000:1.0:1788510403.237168:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852615936 00000100:00100000:3.0:1788510403.237176:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852615808 00000100:00100000:1.0:1788510403.237176:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852615936 00010000:00010000:1.0:1788510403.237211:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a80030a00/0x3e734462ed6541d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7314c expref: 14 pid: 5815 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510403.237420:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a90eafa00/0x3e734462ed65432 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73184 expref: 14 pid: 5815 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510403.237490:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 28 00000100:00100000:0.0:1788510403.237500:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+14:2341:x1875388852615808:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510403.237512:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510403.237522:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a90eafa00/0x3e734462ed65432 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73184 expref: 14 pid: 5815 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510403.237530:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a90eafa00/0x3e734462ed65432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73184 expref: 14 pid: 5815 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510403.237543:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a90eafa00/0x3e734462ed65432 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73184 expref: 14 pid: 5815 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510403.237554:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510403.237598:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852615808:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 100us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510403.237605:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 28 00000100:00100000:1.0:1788510403.238722:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 29 00000100:00100000:1.0:1788510403.238737:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:2340:x1875388852615936:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510403.238751:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510403.238758:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a80030a00/0x3e734462ed6541d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7314c expref: 12 pid: 5815 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238769:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a80030a00/0x3e734462ed6541d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7314c expref: 12 pid: 5815 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238779:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80030a00/0x3e734462ed6541d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7314c expref: 12 pid: 5815 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238792:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238797:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238810:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238825:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238829:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238834:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238837:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510403.238841:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238847:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238861:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510403.238872:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788510403.238888:0:11146:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510403.238896:0:11146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510403.238909:0:11146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83033000/0x3e734462ed6544e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510403.238923:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:2340:x1875388852615936:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 191us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510403.238929:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 29 00000100:00100000:2.0:1788510403.684538:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510403.684580:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510403.684619:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510403.684718:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852616320 00000100:00100000:0.0:1788510403.684729:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852616320 00000100:00100000:0.0:1788510403.684792:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852616192 00000100:00100000:0.0:1788510403.684795:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852616192 00000100:00100000:0.0:1788510403.684817:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 95 00000100:00100000:0.0:1788510403.684827:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2342:x1875388852616320:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510403.684902:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2342:x1875388852616320:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 76us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510403.684909:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 95 00000100:00100000:0.0:1788510403.684928:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 96 00000100:00100000:0.0:1788510403.684934:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2342:x1875388852616192:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510403.684959:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2342:x1875388852616192:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510403.684976:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 96 00000100:00100000:3.0:1788510403.685089:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852616064 00000100:00100000:3.0:1788510403.685094:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852616064 00000100:00100000:3.0:1788510403.685133:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 230 00000100:00100000:3.0:1788510403.685141:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:2342:x1875388852616064:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510403.685179:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:2342:x1875388852616064:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 39us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510403.685186:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 230 00000100:00080000:2.0:1788510403.685765:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788510403.847643:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510404.293533:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861041792:0@lo:400:kworker.0 00000100:00100000:2.0:1788510404.293604:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510404.293654:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861042304:0@lo:400:kworker.0 00000100:00100000:2.0:1788510404.293689:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510404.293739:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788510404.293745:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861041920:0@lo:400:kworker.0 00000100:00100000:2.0:1788510404.293768:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510404.293803:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861041792 00000100:00100000:2.0:1788510404.293812:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861041792 00000100:00100000:2.0:1788510404.293865:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861041920 00000100:00100000:2.0:1788510404.293868:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861041920 00000100:00100000:2.0:1788510404.293900:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788510404.293909:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861041792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510404.293968:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861041792:12345-0@lo:400:kworker.0 Request processed in 59us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510404.293975:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788510404.293992:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788510404.293997:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861041920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510404.294022:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861041920:12345-0@lo:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510404.294028:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788510404.294045:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861042304 00000100:00100000:2.0:1788510404.294048:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861042304 00000100:00100000:2.0:1788510404.294075:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788510404.294081:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861042304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510404.294111:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861042304:12345-0@lo:400:kworker.0 Request processed in 30us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510404.294117:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788510404.294138:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788510404.294144:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510404.294181:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861041920:0@lo:400:kworker.0 00000100:00100000:2.0:1788510404.294205:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861041792:0@lo:400:kworker.0 00010000:00080000:2.0:1788510404.294215:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abaf20a80 x1875388861042304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510404.294261:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861042304:0@lo:400:kworker.0 00000100:00100000:1.0:1788510404.294435:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861041664:0@lo:400:kworker.0 00000100:00100000:1.0:1788510404.294472:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510404.294496:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861042176:0@lo:400:kworker.0 00000100:00100000:1.0:1788510404.294515:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510404.294540:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788510404.294546:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861042048:0@lo:400:kworker.0 00000100:00100000:1.0:1788510404.294568:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510404.294631:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861042176 00000100:00100000:2.0:1788510404.294635:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861042176 00000100:00100000:2.0:1788510404.294683:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788510404.294690:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861042176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510404.294727:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861042176:12345-0@lo:400:kworker.0 Request processed in 37us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510404.294733:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788510404.294896:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861041664 00000100:00100000:3.0:1788510404.294901:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861041664 00000100:00100000:3.0:1788510404.294937:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788510404.294945:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3289:x1875388861041664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510404.294978:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3289:x1875388861041664:12345-0@lo:400:kworker.0 Request processed in 35us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510404.294985:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:1.0:1788510404.295084:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510404.295105:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861041664:0@lo:400:kworker.0 00000100:00100000:1.0:1788510404.295117:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861042176:0@lo:400:kworker.0 00000100:00100000:1.0:1788510404.295422:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861042048 00000100:00100000:1.0:1788510404.295426:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861042048 00000100:00100000:1.0:1788510404.295477:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788510404.295485:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861042048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510404.295530:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861042048:12345-0@lo:400:kworker.0 Request processed in 46us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510404.295536:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788510404.295565:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abaf23b80 x1875388861042048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510404.295577:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861042048:0@lo:400:kworker.0 00000100:00080000:2.0:1788510404.297452:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1788510404.426244:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788510404.426253:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929a85c6b800 from 7 10000000:01000000:1.0:1788510404.426259:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788510404.427057:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510404.427071:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510404.427082:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510404.427121:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861042432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788510404.427201:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510404.427282:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa1f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788510404.427500:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861042432 00000100:00100000:0.0:1788510404.427516:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861042432 00000100:00100000:0.0:1788510404.427576:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788510404.427586:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861042432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510404.427600:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510404.427615:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eae000/0x3e734462ed6545c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65455 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510404.427639:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eae000/0x3e734462ed6545c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65455 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510404.427651:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eae000/0x3e734462ed6545c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65455 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510404.427669:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae000, rc 0) 00000100:00100000:0.0:1788510404.427725:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861042432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510404.427731:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788510404.428103:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861042432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788510404.428121:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510404.428132:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510404.428203:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861042560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510404.428261:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510404.428293:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa1f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788510404.428316:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861042560 00000100:00100000:3.0:1788510404.428322:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861042560 00000100:00100000:3.0:1788510404.428365:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788510404.428374:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861042560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510404.429062:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861042560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 687us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510404.429071:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788510404.430371:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861042560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510404.430715:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861042688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510404.430791:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510404.430874:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa1f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788510404.430926:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861042688 00000100:00100000:3.0:1788510404.430940:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861042688 00000100:00100000:3.0:1788510404.431028:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788510404.431038:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861042688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788510404.431218:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861042688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510404.431243:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788510404.431341:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861042688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788510404.431999:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788510404.432064:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788510404.432081:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788510404.432092:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510404.432104:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510404.432124:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788510404.432127:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929ab4b11000 from 7 10000000:01000000:1.0:1788510404.432130:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788510404.432161:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510404.432169:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510404.432179:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510404.432197:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861042816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788510404.432270:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510404.432565:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa1f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788510404.432601:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861042816 00000100:00100000:0.0:1788510404.432606:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861042816 00000100:00100000:0.0:1788510404.432635:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788510404.432641:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861042816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510404.432653:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510404.432677:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eaee00/0x3e734462ed6546a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65463 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510404.432699:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eaee00/0x3e734462ed6546a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65463 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510404.432709:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eaee00/0x3e734462ed6546a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65463 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510404.432724:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaee00, rc 0) 00000100:00100000:0.0:1788510404.432758:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861042816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510404.432764:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788510404.432929:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861042816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788510404.432942:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510404.432952:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510404.433000:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861042944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510404.433026:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510404.433080:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa1f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788510404.433171:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861042944 00000100:00100000:0.0:1788510404.433175:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861042944 00000100:00100000:0.0:1788510404.433265:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788510404.433273:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861042944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510404.436431:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861042944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3153us (3399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510404.436444:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788510404.436560:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861042944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510404.436613:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861043072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510404.436674:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510404.436886:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa1f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788510404.436934:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861043072 00000100:00100000:3.0:1788510404.436942:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861043072 00000100:00100000:3.0:1788510404.436978:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788510404.436987:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861043072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788510404.437136:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861043072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510404.437143:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788510404.438925:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861043072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788510404.441108:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788510404.447396:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788510404.447805:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788510404.447819:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510404.447832:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510404.447843:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788510404.447846:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929a82ae6000 from 7 10000000:01000000:1.0:1788510404.447849:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788510404.447897:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510404.447905:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510404.447916:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510404.447945:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861043200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788510404.448017:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510404.448072:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788510404.448128:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861043200 00000100:00100000:2.0:1788510404.448140:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861043200 00000100:00100000:2.0:1788510404.448204:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788510404.448214:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861043200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510404.448262:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510404.448348:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929aaec76000/0x3e734462ed65478 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed65471 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510404.448376:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929aaec76000/0x3e734462ed65478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed65471 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510404.448387:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929aaec76000/0x3e734462ed65478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65471 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510404.448396:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76000, rc 0) 00000100:00100000:2.0:1788510404.448457:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861043200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510404.448464:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788510404.449655:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861043200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510404.449694:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510404.449707:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510404.449789:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861043328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510404.449838:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510404.449871:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab5054540 going to sleep for 11 seconds 00000100:00100000:1.0:1788510404.453651:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861043328 00000100:00100000:1.0:1788510404.453679:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861043328 00000100:00100000:1.0:1788510404.453796:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788510404.453807:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861043328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510404.454139:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861043328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (4299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510404.454146:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788510404.454258:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861043328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510404.454329:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861043456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510404.454390:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510404.455852:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab5054540 going to sleep for 11 seconds 00000100:00100000:3.0:1788510404.459564:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861043456 00000100:00100000:3.0:1788510404.459583:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861043456 00000100:00100000:3.0:1788510404.459645:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788510404.459666:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861043456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788510404.459930:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861043456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (5539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510404.459939:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788510404.460554:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861043456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788510404.464966:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788510404.465165:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788510404.465186:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788510404.465196:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510404.465207:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510404.582398:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510404.582529:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852616448 00000100:00100000:3.0:1788510404.582543:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852616448 00000100:00100000:3.0:1788510404.582605:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 241 00000100:00100000:3.0:1788510404.582618:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:5585:x1875388852616448:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788510404.582637:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510404.582666:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a81532200/0x3e734462ed6547f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731ae expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510404.582719:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a81532200/0x3e734462ed6547f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ae expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510404.582733:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a81532200/0x3e734462ed6547f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ae expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510404.582746:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81532200, rc 0) 00000100:00100000:3.0:1788510404.582854:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852616448:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 Request processed in 238us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510404.582861:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 241 00000100:00100000:3.0:1788510404.586441:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510404.592888:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852616576 00000100:00100000:2.0:1788510404.592903:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852616576 00000100:00100000:2.0:1788510404.593118:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 242 00000100:00100000:2.0:1788510404.593129:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852616576:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788510404.593474:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852616576:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 Request processed in 346us (7046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510404.593482:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 242 00000100:00100000:3.0:1788510404.598965:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510404.599133:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852616704 00000100:00100000:1.0:1788510404.599143:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852616704 00000100:00100000:1.0:1788510404.599206:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 243 00000100:00100000:1.0:1788510404.599216:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852616704:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510404.599603:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852616704:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 Request processed in 386us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510404.599613:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 243 00000100:00100000:3.0:1788510404.612952:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510404.618022:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852616832 00000100:00100000:2.0:1788510404.618042:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852616832 00000100:00100000:3.0:1788510404.618237:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 244 00000100:00100000:3.0:1788510404.618250:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852616832:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788510404.618268:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510404.618287:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fd000/0x3e734462ed65486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510404.618387:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fd000/0x3e734462ed65486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731b5 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510404.618512:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fd000/0x3e734462ed65486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731b5 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510404.618523:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fd000, rc 0) 00000100:00100000:3.0:1788510404.618587:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:5585:x1875388852616832:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 Request processed in 339us (5644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510404.618601:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 244 00000100:00100000:2.0:1788510404.622847:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510404.622927:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852616960 00000100:00100000:3.0:1788510404.622936:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852616960 00000100:00100000:3.0:1788510404.623060:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 245 00000100:00100000:3.0:1788510404.623072:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:5585:x1875388852616960:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510404.623577:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:5585:x1875388852616960:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 Request processed in 505us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510404.623586:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 245 00000100:00100000:2.0:1788510404.626935:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510404.627081:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852617088 00000100:00100000:3.0:1788510404.627091:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852617088 00000100:00100000:3.0:1788510404.627184:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 246 00000100:00100000:3.0:1788510404.627194:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:5585:x1875388852617088:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788510404.627558:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:5585:x1875388852617088:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 Request processed in 363us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510404.627566:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 246 00000100:00100000:2.0:1788510404.805606:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861043584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510404.805698:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510404.805773:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861043584 00000100:00100000:2.0:1788510404.805781:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861043584 00000100:00100000:2.0:1788510404.805826:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788510404.805834:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861043584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788510404.805871:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510404.805914:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861043584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510404.805920:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788510404.805958:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd4380 x1875388861043584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510404.805978:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861043584:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788510404.868405:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510405.909301:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788510406.757374:0:11344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788510406.917420:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510407.367650:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788510407.367675:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861043712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510407.367757:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510407.370346:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861043712 00000100:00100000:0.0:1788510407.370362:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861043712 00000100:00100000:0.0:1788510407.370464:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788510407.370476:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861043712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788510407.370521:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510407.370627:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861043712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (2868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510407.370635:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788510407.370712:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788510407.370797:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7dd4380 x1875388861043712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510407.370818:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861043712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788510407.941674:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510408.805030:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510408.805180:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852617216 00000100:00100000:1.0:1788510408.805190:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852617216 00000100:00100000:3.0:1788510408.805405:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510408.805435:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510408.805456:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852617472 00000100:00100000:3.0:1788510408.805460:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852617472 00000100:00100000:3.0:1788510408.805504:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852617344 00000100:00100000:3.0:1788510408.805508:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852617344 00000100:00100000:3.0:1788510408.805551:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 100 00000100:00100000:3.0:1788510408.805560:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852617472:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510408.805605:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 101 00000100:00100000:0.0:1788510408.805617:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852617344:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510408.805662:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852617472:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 102us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510408.805671:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 100 00000100:00080000:3.0:1788510408.805695:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510408.805712:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 247 00000100:00100000:1.0:1788510408.805722:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852617216:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510408.809510:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852617344:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 3879us (4057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510408.809529:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 101 00000100:00100000:1.0:1788510408.819243:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852617216:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 13495us (14194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510408.819259:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 247 00010000:00010000:0.0:1788510408.965941:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510409.413153:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861043968:0@lo:400:kworker.0 00000100:00100000:2.0:1788510409.413259:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510409.413323:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861044480:0@lo:400:kworker.0 00000100:00100000:2.0:1788510409.413352:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510409.413385:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788510409.413391:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861044096:0@lo:400:kworker.0 00000100:00100000:2.0:1788510409.413428:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510409.413714:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861043840:0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.413757:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510409.413784:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861044352:0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.413807:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510409.413825:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788510409.413831:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861044224:0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.413853:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510409.413883:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861043968 00000100:00100000:3.0:1788510409.413893:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861043968 00000100:00100000:3.0:1788510409.413941:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861044096 00000100:00100000:3.0:1788510409.413945:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861044096 00000100:00100000:3.0:1788510409.413987:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861044352 00000100:00100000:3.0:1788510409.413990:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861044352 00000100:00100000:3.0:1788510409.414008:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788510409.414016:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861043968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.414072:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861043968:12345-0@lo:400:kworker.0 Request processed in 56us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510409.414079:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788510409.414105:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788510409.414111:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861044096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.414138:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861044096:12345-0@lo:400:kworker.0 Request processed in 28us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510409.414159:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788510409.414172:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788510409.414177:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861044352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.414207:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861044352:12345-0@lo:400:kworker.0 Request processed in 30us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510409.414213:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788510409.414253:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861043840 00000100:00100000:3.0:1788510409.414257:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861043840 00000100:00100000:3.0:1788510409.414280:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788510409.414286:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861043840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.414314:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861043840:12345-0@lo:400:kworker.0 Request processed in 28us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510409.414320:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788510409.414347:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861044480 00000100:00100000:3.0:1788510409.414351:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861044480 00000100:00100000:3.0:1788510409.414373:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861044224 00000100:00100000:3.0:1788510409.414376:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861044224 00000100:00100000:3.0:1788510409.414393:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788510409.414399:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861044480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.414425:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861044480:12345-0@lo:400:kworker.0 Request processed in 27us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510409.414431:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788510409.414440:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788510409.414445:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861044224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.414465:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861044224:12345-0@lo:400:kworker.0 Request processed in 21us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510409.414479:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788510409.414497:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788510409.414501:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788510409.414503:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788510409.414529:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab50ec700 x1875388861044224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510409.414543:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861044224:0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.414552:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861043840:0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.414560:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861044352:0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.414611:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861044096:0@lo:400:kworker.0 00000100:00100000:3.0:1788510409.414620:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861043968:0@lo:400:kworker.0 00010000:00080000:3.0:1788510409.414629:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abaf23b80 x1875388861044480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510409.414636:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861044480:0@lo:400:kworker.0 00000100:00100000:2.0:1788510409.925838:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788510409.925861:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861044608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510409.925936:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510409.926008:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861044608 00000100:00100000:2.0:1788510409.926016:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861044608 00000100:00100000:2.0:1788510409.926066:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788510409.926076:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861044608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788510409.926112:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510409.926157:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861044608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510409.926165:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788510409.926207:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abaf23b80 x1875388861044608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510409.926252:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861044608:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788510409.990602:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788510410.487946:0:11444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:26:48 (1788510408) === 00000100:00100000:3.0:1788510410.789547:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510410.789784:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852617600 00000100:00100000:0.0:1788510410.789795:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852617600 00000100:00100000:0.0:1788510410.789876:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:0.0:1788510410.789887:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2343:x1875388852617600:12345-192.168.201.4@tcp:41:mkdir.0 00000004:00000024:0.0:1788510410.789930:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788510410.790026:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2343:x1875388852617600:12345-192.168.201.4@tcp:41:mkdir.0 Request processed in 141us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510410.790034:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00080000:3.0:1788510410.790508:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510410.791447:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510410.791542:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852617728 00000100:00100000:0.0:1788510410.792756:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852617728 00000100:00100000:0.0:1788510410.792826:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:0.0:1788510410.792837:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:9668:x1875388852617728:12345-192.168.201.4@tcp:700:mkdir.0 00000100:00100000:0.0:1788510410.792931:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:9668:x1875388852617728:12345-192.168.201.4@tcp:700:mkdir.0 Request processed in 95us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510410.792939:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:2.0:1788510410.796725:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510410.796860:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852617984 00000100:00100000:3.0:1788510410.796872:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852617984 00000100:00100000:3.0:1788510410.796939:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:3.0:1788510410.796949:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:9668:x1875388852617984:12345-192.168.201.4@tcp:36:mkdir.0 00010000:00010000:3.0:1788510410.797029:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510410.797073:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032800/0x3e734462ed6536e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73137 expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.797123:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a82b92200) 00010000:00010000:3.0:1788510410.797160:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788510410.798447:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6548d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.798474:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6548d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.798485:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6548d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.798534:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed65494 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.798541:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed65494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.798558:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed65494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510410.800956:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788510410.800979:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6548d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.800992:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6548d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.801142:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6548d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.801154:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510410.801429:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6548d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.801443:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6548d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.801461:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eabc00) 00010000:00010000:3.0:1788510410.801464:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510410.801468:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6548d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.801474:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6548d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788510410.801494:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e151d6c reply state 000000003d02551c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed65494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510410.801503:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788510410.801699:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:9668:x1875388852617984:12345-192.168.201.4@tcp:36:mkdir.0 Request processed in 4747us (4982us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788510410.801709:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 15 00010000:00010000:0.0:1788510410.808176:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed65494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.808202:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed65494 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.808211:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed65494 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.808218:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510410.808280:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed65494 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.808325:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed65494 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.808352:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff929a83eabf00) 00010000:00010000:0.0:1788510410.808357:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510410.808365:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed65494 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.808376:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed65494 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510410.823126:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510410.829050:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852618112 00000100:00100000:0.0:1788510410.829067:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852618112 00000100:00100000:0.0:1788510410.829155:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:0.0:1788510410.829174:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:9670:x1875388852618112:12345-192.168.201.4@tcp:101:chmod.0 00010000:00010000:0.0:1788510410.829195:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510410.829218:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6549b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731bc expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.829333:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed654a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.829348:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed654a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.829360:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed654a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510410.829391:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788510410.829411:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788510410.829472:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed654a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.829512:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6549b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731bc expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.829539:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed654a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731bc expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.829567:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8b8f5900) 00010000:00010000:0.0:1788510410.829573:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788510410.829579:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf200, rc 0) 00000100:00100000:0.0:1788510410.829688:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:9670:x1875388852618112:12345-192.168.201.4@tcp:101:chmod.0 Request processed in 520us (6712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510410.829699:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:3.0:1788510410.832934:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510410.833027:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852618368 00000100:00100000:1.0:1788510410.833037:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852618368 00000100:00100000:1.0:1788510410.833099:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:1.0:1788510410.833109:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:9670:x1875388852618368:12345-192.168.201.4@tcp:36:chmod.0 00010000:00010000:1.0:1788510410.833174:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510410.833201:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed654a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731bc expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.833220:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8b8f5900) 00010000:00010000:1.0:1788510410.833270:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788510410.833296:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654a9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.833309:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.833319:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788510410.833733:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ad7476b reply state 00000000c07ab0b2 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510410.833747:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788510410.833761:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788510410.833905:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:9670:x1875388852618368:12345-192.168.201.4@tcp:36:chmod.0 Request processed in 793us (978us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788510410.833918:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 17 00010000:00010000:0.0:1788510410.837170:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.837186:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654a9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.837193:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.837198:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510410.837203:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.837210:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654a9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.837266:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a82b92a00) 00010000:00010000:0.0:1788510410.837269:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788510410.837274:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654a9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.837280:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654a9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510410.870083:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510410.870209:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852618496 00000100:00100000:2.0:1788510410.870219:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852618496 00000100:00100000:2.0:1788510410.870320:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:2.0:1788510410.870332:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:9671:x1875388852618496:12345-192.168.201.4@tcp:101:chown.0 00010000:00010000:2.0:1788510410.870356:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510410.870380:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed654b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731c3 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.870448:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed654b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.870462:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed654b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.870476:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed654b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510410.870509:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788510410.870512:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510410.870542:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed654b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.870583:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed654b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731c3 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.870603:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed654b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731c3 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.870611:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578d00) 00010000:00010000:2.0:1788510410.870614:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510410.870632:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77c00, rc 0) 00000100:00100000:2.0:1788510410.870688:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:9671:x1875388852618496:12345-192.168.201.4@tcp:101:chown.0 Request processed in 358us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510410.870694:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:2.0:1788510410.876826:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510410.876946:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852618624 00000100:00100000:1.0:1788510410.876959:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852618624 00000100:00100000:1.0:1788510410.877060:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:1.0:1788510410.877076:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:9671:x1875388852618624:12345-192.168.201.4@tcp:101:chown.0 00010000:00010000:1.0:1788510410.877103:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510410.877131:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed654be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877517:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed654c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877537:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed654c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877566:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed654c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877589:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed654cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877600:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed654cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877610:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed654cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877733:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877744:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877754:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510410.877810:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788510410.877815:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510410.877842:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877858:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed654c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877865:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed654c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877873:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed654c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877880:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510410.877887:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed654c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877897:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed654c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877913:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578d00) 00010000:00010000:1.0:1788510410.877918:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510410.877924:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed654c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877932:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed654c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877949:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed654cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877967:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed654cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877973:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed654cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877977:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510410.877980:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed654cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877986:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed654cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.877998:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff929a82b92100) 00010000:00010000:1.0:1788510410.878001:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510410.878005:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed654cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.878013:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed654cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.878064:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed654be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ca expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.878085:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ca expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.878095:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929a82b92d00) 00010000:00010000:1.0:1788510410.878098:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788510410.878113:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033000, rc 0) 00000100:00100000:1.0:1788510410.878202:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:9671:x1875388852618624:12345-192.168.201.4@tcp:101:chown.0 Request processed in 1128us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510410.878213:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:2.0:1788510410.882749:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510410.882927:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852618880 00000100:00100000:0.0:1788510410.882940:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852618880 00000100:00100000:0.0:1788510410.883034:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:0.0:1788510410.883044:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:9671:x1875388852618880:12345-192.168.201.4@tcp:36:chown.0 00010000:00010000:0.0:1788510410.883100:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510410.883124:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed654d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ca expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.883153:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929a82b92d00) 00010000:00010000:0.0:1788510410.883172:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510410.883207:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed654da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.883218:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed654da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.883270:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed654da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510410.926641:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000243047fe reply state 00000000eb3b4dd2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed654da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510410.926679:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788510410.926694:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788510410.926802:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:9671:x1875388852618880:12345-192.168.201.4@tcp:36:chown.0 Request processed in 43755us (44059us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788510410.926816:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 20 00000001:00080000:0.0:1788510410.926886:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1788510410.926937:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed654da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.926952:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed654da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.926960:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed654da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.926966:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafe00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510410.926972:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed654da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.926979:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed654da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.926997:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929a8b8f5300) 00010000:00010000:0.0:1788510410.927000:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788510410.927005:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed654da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.927012:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed654da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510410.947754:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510410.947869:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852619008 00000100:00100000:3.0:1788510410.947880:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852619008 00000100:00100000:3.0:1788510410.947988:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:3.0:1788510410.947997:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:9673:x1875388852619008:12345-192.168.201.4@tcp:101:touch.500 00010000:00010000:3.0:1788510410.948020:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510410.948040:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed654e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788510410.949441:0:5821:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1332us 00010000:00010000:2.0:1788510410.969536:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed654e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.969572:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed654e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.969587:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed654e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.969611:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed654ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.969622:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed654ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.969630:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed654ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970097:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed654f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970111:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed654f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970124:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed654f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510410.970181:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788510410.970187:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510410.970294:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed654f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970313:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed654e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970321:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed654e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970330:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed654e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970338:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510410.970344:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed654e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970355:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed654e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970374:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578d00) 00010000:00010000:2.0:1788510410.970379:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510410.970386:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed654e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970397:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed654e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970415:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed654ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970442:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed654ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970451:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed654ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970457:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510410.970462:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed654ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970469:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed654ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970481:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff929aac578b00) 00010000:00010000:2.0:1788510410.970484:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510410.970487:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed654ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970494:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed654ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970589:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed654e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731d1 expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970614:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed654f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731d1 expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.970624:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929aac578200) 00010000:00010000:2.0:1788510410.970627:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788510410.970641:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77000, rc 0) 00000100:00100000:2.0:1788510410.970742:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:9673:x1875388852619008:12345-192.168.201.4@tcp:101:touch.500 Request processed in 22742us (22994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510410.970754:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:1.0:1788510410.975914:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510410.976200:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852619264 00000100:00100000:3.0:1788510410.976214:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852619264 00000100:00100000:3.0:1788510410.976314:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:3.0:1788510410.976325:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:9673:x1875388852619264:12345-192.168.201.4@tcp:101:touch.500 00010000:00010000:3.0:1788510410.976347:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510410.976369:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fcc00/0x3e734462ed654fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731d8 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.976750:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed65504 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.976766:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed65504 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.976778:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed65504 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.976795:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed6550b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.976801:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed6550b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.976809:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed6550b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788510410.977573:0:9544:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788510410.977850:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65512 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.977872:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.977882:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.977923:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed65504 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.977934:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed65504 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.977943:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed65504 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.977951:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510410.977956:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed65504 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.977964:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed65504 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.977976:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929aac578200) 00010000:00010000:3.0:1788510410.977980:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510410.977987:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed65504 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.977997:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed65504 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788510410.978017:0:9544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c8299f2 reply state 000000000cc11bdd transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed6550b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510410.978045:0:9544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788510410.978105:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fcc00/0x3e734462ed654fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731d8 expref: 10 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.978132:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731d8 expref: 9 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510410.978144:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff929a83eab800) 00010000:00010000:3.0:1788510410.978148:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510410.978152:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a80030a00, rc 0) 00000100:00100000:3.0:1788510410.978266:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:9673:x1875388852619264:12345-192.168.201.4@tcp:101:touch.500 Request processed in 1943us (2364us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788510410.978275:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:0.0:1788510410.988934:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510410.990114:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852619520 00000100:00100000:1.0:1788510410.990128:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852619520 00000100:00100000:1.0:1788510410.990702:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 23 00000100:00100000:1.0:1788510410.990720:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:9673:x1875388852619520:12345-192.168.201.4@tcp:36:touch.500 00010000:00010000:1.0:1788510410.990797:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510410.990833:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65512 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731d8 expref: 10 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.990859:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff929a83eab800) 00010000:00010000:1.0:1788510410.990875:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788510410.990934:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65520 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.990953:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65520 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510410.990963:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65520 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788510410.991097:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050226a0c reply state 00000000f827cbc5 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65520 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510410.991107:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788510410.992002:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:9673:x1875388852619520:12345-192.168.201.4@tcp:36:touch.500 Request processed in 1281us (3075us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788510410.992030:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 23 00010000:00010000:2.0:1788510410.992173:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed6550b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.992183:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed6550b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.992669:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed6550b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.992681:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510410.992688:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed6550b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.992699:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed6550b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.992719:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff929a83eabc00) 00010000:00010000:2.0:1788510410.992724:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510410.992730:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed6550b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.992737:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc400/0x3e734462ed6550b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.995112:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65520 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.995127:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65520 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.995134:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65520 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.995141:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510410.995145:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65520 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.995153:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65520 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.995178:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff929a82b92b00) 00010000:00010000:0.0:1788510410.995182:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510410.995186:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65520 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510410.995193:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65520 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510410.996774:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510410.996839:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852619648 00000100:00100000:2.0:1788510410.996850:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852619648 00000100:00100000:2.0:1788510410.996908:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 24 00000100:00100000:2.0:1788510410.996916:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:9673:x1875388852619648:12345-192.168.201.4@tcp:101:touch.500 00010000:00010000:2.0:1788510410.996945:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510410.996965:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65527 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731df expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.997023:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65527 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731df expref: 10 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.997038:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65527 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731df expref: 10 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510410.997058:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff929aac578b00) 00010000:00010000:2.0:1788510410.997061:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788510410.997064:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76400, rc 0) 00000100:00100000:2.0:1788510410.997121:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:9673:x1875388852619648:12345-192.168.201.4@tcp:101:touch.500 Request processed in 206us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510410.997128:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 24 00000100:00100000:0.0:1788510411.000128:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510411.000723:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852619776 00000100:00100000:3.0:1788510411.000737:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852619776 00000100:00100000:3.0:1788510411.000934:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:3.0:1788510411.000946:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2339:x1875388852619776:12345-192.168.201.4@tcp:8:touch.500 00010000:00080000:3.0:1788510411.000981:0:6670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1788510411.001014:0:6670:0:(genops.c:1385:class_connect()) connect: client cef40ebf-ceed-4c16-b27b-e8bced3a8d2f, cookie 0x3e734462ed6552e 00002000:00100000:3.0:1788510411.001029:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cef40ebf-ceed-4c16-b27b-e8bced3a8d2f/ffff929a830ff800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788510411.001041:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:3.0:1788510411.001752:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788510411.001791:0:6670:0:(import.c:65:import_set_state_nolock()) ffff929a830fe000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788510411.001862:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2339:x1875388852619776:12345-192.168.201.4@tcp:8:touch.500 Request processed in 915us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510411.001893:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:0.0:1788510411.004895:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510411.005004:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852619904 00000100:00100000:1.0:1788510411.005018:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852619904 00000100:00100000:1.0:1788510411.005210:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:1.0:1788510411.005541:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:0:x1875388852619904:12345-192.168.201.4@tcp:2:touch.500 00000100:00080000:3.0:1788510411.007583:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788510411.012902:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788510411.040940:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1788510411.040975:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000100:00100000:2.0:1788510411.041571:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:0:x1875388852619904:12345-192.168.201.4@tcp:2:touch.500 Request processed in 36342us (36675us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788510411.041587:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:2.0:1788510411.046323:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510411.046585:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852620160 00000100:00100000:1.0:1788510411.046598:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852620160 00000100:00100000:1.0:1788510411.046690:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 2 00000100:00100000:1.0:1788510411.046706:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:9673:x1875388852620160:12345-192.168.201.4@tcp:35:touch.500 00000100:00100000:1.0:1788510411.047560:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:9673:x1875388852620160:12345-192.168.201.4@tcp:35:touch.500 Request processed in 840us (1228us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788510411.047577:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 2 00000100:00100000:0.0:1788510411.062779:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510411.062939:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852620288 00000100:00100000:2.0:1788510411.062953:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852620288 00000100:00100000:2.0:1788510411.063023:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 25 00000100:00100000:2.0:1788510411.063040:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:9674:x1875388852620288:12345-192.168.201.4@tcp:101:rm.0 00010000:00010000:2.0:1788510411.063070:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510411.063100:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731e6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.063655:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed6553c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.063674:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed6553c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.063687:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed6553c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510411.063730:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788510411.063734:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510411.063775:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed6553c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.063809:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731e6 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.063834:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed6553c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731e6 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.063846:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929aac578200) 00010000:00010000:2.0:1788510411.063849:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510411.063854:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76600, rc 0) 00000100:00100000:2.0:1788510411.064113:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+12:9674:x1875388852620288:12345-192.168.201.4@tcp:101:rm.0 Request processed in 1075us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510411.064125:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 25 00000100:00100000:3.0:1788510411.072809:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510411.072892:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852620544 00000100:00100000:1.0:1788510411.072901:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852620544 00000100:00100000:1.0:1788510411.072956:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 26 00000100:00100000:1.0:1788510411.072965:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+12:9674:x1875388852620544:12345-192.168.201.4@tcp:101:rm.0 00010000:00010000:1.0:1788510411.072986:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510411.073007:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731ed expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510411.073096:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788510411.073332:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65543 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ed expref: 14 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510411.073346:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578d00) 00010000:00010000:1.0:1788510411.073355:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788510411.073362:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ed expref: 14 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510411.073376:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033c00, rc 0) 00000100:00100000:1.0:1788510411.074048:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:9674:x1875388852620544:12345-192.168.201.4@tcp:101:rm.0 Request processed in 1080us (1244us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788510411.074058:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 26 00000100:00100000:0.0:1788510411.085048:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510411.085658:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852620672 00000100:00100000:3.0:1788510411.085672:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852620672 00000100:00100000:3.0:1788510411.085798:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 3 00000100:00100000:3.0:1788510411.085816:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:9674:x1875388852620672:12345-192.168.201.4@tcp:37:rm.0 00000100:00100000:3.0:1788510411.092147:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:9674:x1875388852620672:12345-192.168.201.4@tcp:37:rm.0 Request processed in 6325us (7101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510411.092169:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 3 00000100:00100000:2.0:1788510411.096586:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510411.096686:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852620928 00000100:00100000:1.0:1788510411.096699:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852620928 00000100:00100000:1.0:1788510411.096812:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:1.0:1788510411.096825:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:9674:x1875388852620928:12345-192.168.201.4@tcp:35:rm.0 00000100:00100000:1.0:1788510411.097096:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:9674:x1875388852620928:12345-192.168.201.4@tcp:35:rm.0 Request processed in 273us (520us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788510411.097105:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:0.0:1788510411.101207:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510411.101579:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852621184 00000100:00100000:1.0:1788510411.101593:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852621184 00000100:00100000:1.0:1788510411.101682:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 27 00000100:00100000:1.0:1788510411.101696:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:9674:x1875388852621184:12345-192.168.201.4@tcp:101:rm.0 00010000:00010000:1.0:1788510411.101728:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510411.101757:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731f4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510411.101883:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65558 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510411.101903:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65558 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510411.101941:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65558 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510411.101958:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788510411.102115:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731f4 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510411.102140:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65558 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731f4 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510411.102150:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929aac578200) 00010000:00010000:1.0:1788510411.102154:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788510411.102158:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032600, rc 0) 00000100:00100000:1.0:1788510411.102580:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:9674:x1875388852621184:12345-192.168.201.4@tcp:101:rm.0 Request processed in 887us (1399us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788510411.102589:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 27 00000100:00100000:0.0:1788510411.106951:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510411.107044:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852621312 00000100:00100000:1.0:1788510411.107054:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852621312 00000100:00100000:1.0:1788510411.107153:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 28 00000100:00100000:1.0:1788510411.107172:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:9674:x1875388852621312:12345-192.168.201.4@tcp:41:rm.0 00000004:00000024:1.0:1788510411.107451:0:9544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788510411.107530:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:9674:x1875388852621312:12345-192.168.201.4@tcp:41:rm.0 Request processed in 367us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510411.107536:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 28 00000100:00100000:2.0:1788510411.110318:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510411.110464:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852621440 00000100:00100000:3.0:1788510411.110475:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852621440 00000100:00100000:3.0:1788510411.110524:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 29 00000100:00100000:3.0:1788510411.110533:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:9674:x1875388852621440:12345-192.168.201.4@tcp:101:rm.0 00010000:00010000:3.0:1788510411.110561:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510411.110581:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031a00/0x3e734462ed65566 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc731fb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110636:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed6556d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110650:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed6556d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110661:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed6556d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110675:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed65574 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110687:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed65574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110694:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed65574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110791:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed6557b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110799:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed6557b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110806:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed6557b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510411.110831:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788510411.110835:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510411.110850:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed6557b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110862:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed6557b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110870:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed6556d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110876:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed6556d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110883:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed6556d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110897:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80030c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510411.110901:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed6556d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110909:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed6556d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110919:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929aac578200) 00010000:00010000:3.0:1788510411.110922:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510411.110927:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed6556d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110933:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed6556d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110945:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed65574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110951:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed65574 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110957:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed65574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110961:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80031600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510411.110963:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed65574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110968:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed65574 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110984:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff929a83eaba00) 00010000:00010000:3.0:1788510411.110986:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510411.110989:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed65574 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.110995:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed65574 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.111026:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031a00/0x3e734462ed65566 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731fb expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.111038:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed6557b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731fb expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.111045:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff929aac578b00) 00010000:00010000:3.0:1788510411.111048:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510411.111050:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a80030a00, rc 0) 00000100:00100000:3.0:1788510411.111112:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:9674:x1875388852621440:12345-192.168.201.4@tcp:101:rm.0 Request processed in 580us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510411.111118:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 29 00000100:00100000:2.0:1788510411.114698:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510411.114863:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852621696 00000100:00100000:0.0:1788510411.114880:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852621696 00000100:00100000:0.0:1788510411.114975:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 30 00000100:00100000:0.0:1788510411.114988:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:9674:x1875388852621696:12345-192.168.201.4@tcp:36:rm.0 00010000:00010000:0.0:1788510411.115051:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788510411.115080:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed6557b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731fb expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.115103:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65527 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731df expref: 16 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.115116:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff929aac578b00) 00010000:00010000:0.0:1788510411.115133:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed6553c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731e6 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.115140:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510411.115155:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510411.115177:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65582 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.115190:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65582 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.115217:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65582 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.115683:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65589 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.115696:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.115707:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.115854:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65590 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.115863:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.115871:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788510411.116955:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788510411.116967:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 268935743955ns, next at 269935741786ns, rc = 0 00010000:00010000:0.0:1788510411.117035:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae600/0x3e734462ed65597 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.117048:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae600/0x3e734462ed65597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.117058:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae600/0x3e734462ed65597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.117076:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae600/0x3e734462ed65597 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.117082:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae600/0x3e734462ed65597 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.117089:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae600/0x3e734462ed65597 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.117122:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788510411.117796:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510411.117806:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae600/0x3e734462ed65597 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.117814:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510411.117818:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae600/0x3e734462ed65597 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.117826:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae600/0x3e734462ed65597 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.117849:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:3.0:1788510411.117853:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788510411.117858:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae600/0x3e734462ed65597 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.117863:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae600/0x3e734462ed65597 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510411.117879:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510411.117881:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510411.117883:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510411.117954:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.117961:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65590 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.117967:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65590 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.117972:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510411.117976:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65590 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.117983:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65590 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.117991:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:0.0:1788510411.117993:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788510411.117996:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65590 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.118002:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65590 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.118033:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65582 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.118039:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65582 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.118045:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65582 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.118050:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510411.118053:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65582 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.118058:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65582 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.118067:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510411.118069:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510411.118072:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65582 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.118077:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65582 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510411.118086:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000729aea70 reply state 00000000a54f91e4 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510411.118096:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788510411.118618:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:9674:x1875388852621696:12345-192.168.201.4@tcp:36:rm.0 Request processed in 3628us (3931us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788510411.118626:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 30 00000100:00100000:2.0:1788510411.122208:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00010000:00010000:0.0:1788510411.122350:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.122365:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65589 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.122373:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65589 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.122379:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510411.122384:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65589 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.122393:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65589 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.122412:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff929a8b8f5300) 00010000:00010000:0.0:1788510411.122415:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510411.122419:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65589 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.122425:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65589 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510411.122777:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852621952 00000100:00100000:3.0:1788510411.122788:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852621952 00000100:00100000:3.0:1788510411.122845:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 5 00000100:00100000:3.0:1788510411.122855:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:9674:x1875388852621952:12345-192.168.201.4@tcp:35:rm.0 00000100:00100000:3.0:1788510411.123085:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:9674:x1875388852621952:12345-192.168.201.4@tcp:35:rm.0 Request processed in 231us (892us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788510411.123093:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 5 00000100:00100000:2.0:1788510411.128167:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510411.128396:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852622208 00000100:00100000:0.0:1788510411.128409:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852622208 00000100:00100000:0.0:1788510411.128483:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 31 00000100:00100000:0.0:1788510411.128494:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:9674:x1875388852622208:12345-192.168.201.4@tcp:36:rm.0 00010000:00010000:0.0:1788510411.128570:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788510411.128601:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65558 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731f4 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.128648:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed654f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731d1 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.128658:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510411.128673:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed654b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731c3 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.128680:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578d00) 00010000:00010000:0.0:1788510411.128686:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510411.128712:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaea00/0x3e734462ed6559e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.128725:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaea00/0x3e734462ed6559e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.128734:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaea00/0x3e734462ed6559e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.128747:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed655a5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.128755:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed655a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.128764:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed655a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.129041:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed655ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.129061:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed655ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.129068:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed655ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510411.132508:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788510411.132552:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed655ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132565:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed655ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132574:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed655ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132580:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafe00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510411.132585:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed655ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132594:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed655ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132610:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff929a8b8f5500) 00010000:00010000:0.0:1788510411.132613:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788510411.132618:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed655ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132624:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed655ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132659:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaea00/0x3e734462ed6559e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132682:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaea00/0x3e734462ed6559e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132688:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaea00/0x3e734462ed6559e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132692:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaea00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510411.132695:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaea00/0x3e734462ed6559e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132701:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaea00/0x3e734462ed6559e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132708:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8b8f5a00) 00010000:00010000:0.0:1788510411.132710:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510411.132713:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaea00/0x3e734462ed6559e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510411.132718:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaea00/0x3e734462ed6559e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510411.132730:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005e3f494 reply state 0000000088959713 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed655a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510411.132739:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788510411.132836:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:9674:x1875388852622208:12345-192.168.201.4@tcp:36:rm.0 Request processed in 4340us (4690us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788510411.132846:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 31 00010000:00010000:2.0:1788510411.138699:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed655a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.138719:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed655a5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.138726:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed655a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.138733:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510411.138737:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed655a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.138745:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed655a5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.138761:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff929a8b8f5800) 00010000:00010000:2.0:1788510411.138764:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510411.138769:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed655a5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510411.138775:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed655a5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510412.036659:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510412.487511:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861044736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788510412.487608:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510412.487719:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861044736 00000100:00100000:2.0:1788510412.487727:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861044736 00000100:00100000:2.0:1788510412.487791:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788510412.487800:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861044736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510412.487849:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510412.487894:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861044736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510412.487901:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788510412.487952:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788510412.487982:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abae6b480 x1875388861044736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510412.488002:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861044736:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788510413.062717:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510413.928887:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510413.928929:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510413.928967:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510413.929005:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510413.929093:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852622464 00000100:00100000:3.0:1788510413.929136:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852622464 00000100:00100000:3.0:1788510413.929270:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852622720 00000100:00100000:3.0:1788510413.929274:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852622720 00000100:00100000:3.0:1788510413.929302:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 105 00000100:00100000:3.0:1788510413.929312:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:2341:x1875388852622464:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510413.929402:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:2341:x1875388852622464:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 90us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510413.929411:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 105 00000100:00100000:3.0:1788510413.929428:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 106 00000100:00100000:3.0:1788510413.929434:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852622720:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510413.929457:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852622720:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 24us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510413.929463:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 106 00000100:00080000:2.0:1788510413.929626:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510413.929979:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852622336 00000100:00100000:1.0:1788510413.929985:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852622336 00000100:00100000:1.0:1788510413.930027:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 249 00000100:00100000:1.0:1788510413.930034:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852622336:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510413.930078:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852622336:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 44us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510413.930085:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 249 00000100:00100000:0.0:1788510413.930406:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852622592 00000100:00100000:0.0:1788510413.930418:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852622592 00000100:00100000:0.0:1788510413.930476:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 59 00000100:00100000:0.0:1788510413.930485:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852622592:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510413.930534:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852622592:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 51us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510413.930541:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 59 00000100:00080000:2.0:1788510413.930629:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788510414.086465:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510414.532421:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788510414.532444:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861044992:0@lo:400:kworker.0 00000100:00100000:0.0:1788510414.532522:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510414.532591:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861044992 00000100:00100000:0.0:1788510414.532597:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861044992 00000100:00100000:0.0:1788510414.532639:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788510414.532647:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861044992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510414.532694:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861044992:12345-0@lo:400:kworker.0 Request processed in 47us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510414.532700:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788510414.532742:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861044992:0@lo:400:kworker.0 00000100:00100000:0.0:1788510414.532774:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861045120:0@lo:400:kworker.0 00000100:00100000:0.0:1788510414.532795:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510414.532824:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861045120 00000100:00100000:0.0:1788510414.532828:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861045120 00000100:00100000:0.0:1788510414.532856:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788510414.532863:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861045120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510414.532900:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861045120:12345-0@lo:400:kworker.0 Request processed in 38us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510414.532923:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788510414.532954:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861045120:0@lo:400:kworker.0 00000100:00100000:0.0:1788510414.532992:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788510414.532997:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861045504:0@lo:400:kworker.0 00000100:00100000:0.0:1788510414.533023:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510414.533100:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861045248:0@lo:400:kworker.0 00000100:00100000:2.0:1788510414.533130:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510414.533160:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788510414.533166:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861044864:0@lo:400:kworker.0 00000100:00100000:2.0:1788510414.533194:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510414.533217:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861045376:0@lo:400:kworker.0 00000100:00100000:2.0:1788510414.533270:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788510414.533295:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510414.533310:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861045504 00000100:00100000:2.0:1788510414.533313:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861045504 00000100:00100000:2.0:1788510414.533345:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861045248 00000100:00100000:2.0:1788510414.533348:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861045248 00000100:00100000:2.0:1788510414.533367:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788510414.533373:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861045504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510414.533409:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861045504:12345-0@lo:400:kworker.0 Request processed in 35us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510414.533416:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788510414.533435:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788510414.533441:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861045248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510414.533472:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861045248:12345-0@lo:400:kworker.0 Request processed in 31us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510414.533478:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788510414.533506:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861044864 00000100:00100000:2.0:1788510414.533510:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861044864 00000100:00100000:2.0:1788510414.533533:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788510414.533539:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861044864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510414.533569:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861044864:12345-0@lo:400:kworker.0 Request processed in 30us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510414.533575:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:2.0:1788510414.533605:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788510414.533608:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788510414.533614:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861045376 00000100:00100000:2.0:1788510414.533618:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861045376 00000100:00100000:2.0:1788510414.533644:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788510414.533650:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861045376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510414.533677:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861045376:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510414.533684:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1788510414.533699:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510414.533716:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861044864:0@lo:400:kworker.0 00000100:00100000:2.0:1788510414.533727:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861045376:0@lo:400:kworker.0 00010000:00080000:2.0:1788510414.533738:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abb1a3800 x1875388861045248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510414.533761:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861045248:0@lo:400:kworker.0 00010000:00080000:2.0:1788510414.533790:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abb1a3100 x1875388861045504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510414.533800:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861045504:0@lo:400:kworker.0 00000004:00080000:1.0:1788510415.053407:0:8022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 272872182002ns, next at 273872179818ns, rc = 0 00000100:00100000:2.0:1788510415.053487:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861045632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510415.053561:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510415.053883:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861045632 00000100:00100000:1.0:1788510415.053891:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861045632 00000100:00100000:1.0:1788510415.053945:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788510415.053955:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861045632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788510415.053991:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510415.054050:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861045632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510415.054058:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788510415.054111:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d35180 x1875388861045632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510415.054140:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861045632:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788510415.064436:0:11592:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788510415.109754:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510416.137729:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788510416.147771:0:11642:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc08e6a7d0 20000000:00000080:3.0:1788510416.147787:0:11642:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff929ab7c25c00 uarg=0000000000000000 20000000:01000000:3.0:1788510416.147825:0:11642:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788510416.147831:0:11642:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788510416.147835:0:11642:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788510416.153526:0:11643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788510416.153712:0:11642:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788510416.157148:0:11642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788510416.157210:0:11642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788510416.157300:0:11642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788510416.157318:0:11642:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788510416.157336:0:11642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.157353:0:11642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a90eae000/0x3e734462ed6545c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65455 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.157372:0:11642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a90eaee00/0x3e734462ed6546a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65463 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.157379:0:11642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929aaec76000/0x3e734462ed65478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed65471 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.157388:0:11642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a81532200/0x3e734462ed6547f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ae expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.157395:0:11642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a813fd000/0x3e734462ed65486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731b5 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.157402:0:11642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.157441:0:11642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a813fd000/0x3e734462ed65486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731b5 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.158866:0:11642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a813fd000/0x3e734462ed65486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731b5 expref: 12 pid: 5815 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510416.158890:0:11642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d31880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875388861045760:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510416.159066:0:11642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a81532200/0x3e734462ed6547f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ae expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.159194:0:11642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a81532200/0x3e734462ed6547f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ae expref: 12 pid: 5814 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510416.159204:0:11642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d30e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875388861045888:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510416.159280:0:11642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929aaec76000/0x3e734462ed65478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed65471 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.159289:0:11642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929aaec76000/0x3e734462ed65478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed65471 expref: 18 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510416.159298:0:11642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875388861046016:0@lo:104: 00000100:00100000:3.0:1788510416.159337:0:11642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788510416.159376:0:11642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a90eaee00/0x3e734462ed6546a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed65463 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.159384:0:11642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a90eaee00/0x3e734462ed6546a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed65463 expref: 18 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510416.159391:0:11642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875388861046144:0@lo:104: 00000100:00100000:3.0:1788510416.159411:0:11642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788510416.159437:0:11642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a90eae000/0x3e734462ed6545c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed65455 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.159446:0:11642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff929a90eae000/0x3e734462ed6545c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed65455 expref: 18 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510416.159466:0:11642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab50edc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875388861046272:0@lo:104: 00000100:00100000:3.0:1788510416.159489:0:11642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510416.159501:0:11642:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aae953a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788510416.159576:0:7609:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788510416.159588:0:7609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861046016 00000100:00100000:0.0:1788510416.159594:0:7609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861046016 00000100:00100000:0.0:1788510416.159631:0:7609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861046144 00000100:00100000:0.0:1788510416.159633:0:7609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861046144 00000100:00100000:0.0:1788510416.159641:0:7609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861046272 00000100:00100000:0.0:1788510416.159643:0:7609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861046272 00000100:00100000:0.0:1788510416.159654:0:7609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788510416.159663:0:7609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+5:11642:x1875388861046016:12345-0@lo:104: 00010000:00010000:0.0:1788510416.159675:0:7609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.159730:0:7609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788510416.159735:0:7609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+5:11642:x1875388861046016:12345-0@lo:104: Request processed in 74us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510416.159740:0:7609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788510416.159754:0:7609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788510416.159759:0:7609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+4:11642:x1875388861046144:12345-0@lo:104: 00010000:00010000:0.0:1788510416.159764:0:7609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.159800:0:7609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788510416.159805:0:7609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+4:11642:x1875388861046144:12345-0@lo:104: Request processed in 46us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510416.159810:0:7609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788510416.159819:0:7609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788510416.159824:0:7609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae978c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+3:11642:x1875388861046272:12345-0@lo:104: 00010000:00010000:0.0:1788510416.159830:0:7609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.159850:0:7609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788510416.159854:0:7609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae978c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+3:11642:x1875388861046272:12345-0@lo:104: Request processed in 30us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510416.159858:0:7609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788510416.159890:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788510416.159895:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.159901:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032e00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:0.0:1788510416.159905:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.159913:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788510416.159920:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510416.159926:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788510416.159956:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.159961:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788510416.159979:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.159986:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed65471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed65478 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.159997:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788510416.159999:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.160004:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032200 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:0.0:1788510416.160006:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.160012:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788510416.160018:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510416.160022:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788510416.160031:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.160036:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788510416.160040:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.160054:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a83032200/0x3e734462ed65463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6546a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.160062:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510416.160064:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.160069:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc1b70c20) 00000100:00100000:3.0:1788510416.160239:0:11642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875388861046016:0@lo:104: 00000100:00100000:3.0:1788510416.160249:0:11642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875388861046144:0@lo:104: 00000100:00100000:3.0:1788510416.160254:0:11642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab50edc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875388861046272:0@lo:104: 00010000:00010000:1.0:1788510416.160484:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510416.160497:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861046528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510416.160534:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510416.160567:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788510416.160573:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861046400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510416.160592:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510416.160623:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861046528 00000100:00100000:1.0:1788510416.160627:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861046528 00010000:00010000:1.0:1788510416.160648:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a90eaee00/0x3e734462ed6546a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65463 expref: 19 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510416.160668:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861046400 00000100:00100000:1.0:1788510416.160671:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861046400 00010000:00010000:1.0:1788510416.160680:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929aaec76000/0x3e734462ed65478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65471 expref: 20 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510416.160690:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788510416.160696:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+20:3289:x1875388861046528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510416.160707:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510416.160712:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a90eaee00/0x3e734462ed6546a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65463 expref: 20 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.160722:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a90eaee00/0x3e734462ed6546a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed65463 expref: 20 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.160736:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a90eaee00/0x3e734462ed6546a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed65463 expref: 20 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.160749:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510416.160772:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861046528:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510416.160778:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788510416.160791:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788510416.160797:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:3289:x1875388861046400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510416.160804:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510416.160808:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929aaec76000/0x3e734462ed65478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65471 expref: 18 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.160821:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929aaec76000/0x3e734462ed65478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed65471 expref: 18 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.160831:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929aaec76000/0x3e734462ed65478 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed65471 expref: 18 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.160840:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510416.160859:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:3289:x1875388861046400:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510416.160865:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788510416.160893:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861046400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510416.160899:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861046528:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1788510416.160965:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.160973:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788510416.160978:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510416.160984:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788510416.161968:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.161979:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788510416.161996:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.162003:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a83032400/0x3e734462ed65455 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed6545c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510416.162019:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510416.162027:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510416.162029:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510416.162299:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510416.162315:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861046656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510416.162366:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510416.162415:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861046656 00000100:00100000:1.0:1788510416.162422:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861046656 00010000:00010000:1.0:1788510416.162447:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a90eae000/0x3e734462ed6545c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65455 expref: 17 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510416.162482:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788510416.162489:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:3291:x1875388861046656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510416.162498:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510416.162503:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a90eae000/0x3e734462ed6545c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed65455 expref: 17 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.162513:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a90eae000/0x3e734462ed6545c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed65455 expref: 17 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.162532:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a90eae000/0x3e734462ed6545c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed65455 expref: 17 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.162543:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510416.162575:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3291:x1875388861046656:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510416.162583:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788510416.162634:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861046656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788510416.167591:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510416.167682:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510416.167712:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852622848 00000100:00100000:2.0:1788510416.167720:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852622848 00010000:00010000:2.0:1788510416.167754:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a813fd000/0x3e734462ed65486 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731b5 expref: 13 pid: 5815 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510416.167784:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852622976 00000100:00100000:2.0:1788510416.167788:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852622976 00010000:00010000:2.0:1788510416.167799:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a81532200/0x3e734462ed6547f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ae expref: 14 pid: 5814 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510416.167814:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00100000:2.0:1788510416.167822:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+14:2341:x1875388852622848:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510416.167834:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510416.167839:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a813fd000/0x3e734462ed65486 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731b5 expref: 14 pid: 5815 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.167851:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a813fd000/0x3e734462ed65486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731b5 expref: 14 pid: 5815 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.167885:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510416.167936:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+14:2341:x1875388852622848:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 114us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510416.167944:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00100000:2.0:1788510416.167963:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 34 00000100:00100000:2.0:1788510416.167969:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852622976:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510416.167978:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510416.167982:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a81532200/0x3e734462ed6547f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ae expref: 13 pid: 5814 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.167990:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a81532200/0x3e734462ed6547f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ae expref: 13 pid: 5814 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.168002:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.168010:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.168025:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.168033:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.168040:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.168046:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.168058:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80031600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510416.168062:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.168079:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.168089:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.169803:0:11642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fd000/0x3e734462ed65486 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731b5 expref: 13 pid: 5815 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510416.169831:0:11642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d31880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875388861045760:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510416.169848:0:11642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81532200/0x3e734462ed6547f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc731ae expref: 12 pid: 5814 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510416.169858:0:11642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d30e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875388861045888:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510416.169889:0:11642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 2/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.169901:0:11642:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 2/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510416.169906:0:11642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 2/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.170572:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80031600/0x3e734462ed655b3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510416.170594:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510416.170649:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:2341:x1875388852622976:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 2678us (2965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510416.170659:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 34 00000001:00080000:1.0:1788510416.187645:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788510416.187667:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:1.0:1788510416.187681:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1788510416.187814:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861046784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788510416.187880:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510416.187934:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861046784 00000100:00100000:1.0:1788510416.187941:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861046784 00000100:00100000:1.0:1788510416.187998:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788510416.188007:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861046784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788510416.188035:0:6669:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788510416.188066:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9a80ca, atime: 0x6a9a80ca, ctime: 0x6a9a80ca, blocks: 0x1 00010000:00010000:1.0:1788510416.188088:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb90ff3/0x3e734462ed655ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.188105:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=274s v=(0 0) 00010000:00010000:1.0:1788510416.188109:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510416.188116:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bb90ff3/0x3e734462ed655ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.188161:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bb90ff3/0x3e734462ed655ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.188173:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb90ff3/0x3e734462ed655ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.188182:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bb90ff3/0x3e734462ed655ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.188200:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788510416.188771:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1875388861046784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 763us (889us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788510416.188778:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788510416.188809:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788510416.188821:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510416.188826:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bb90ff3/0x3e734462ed655ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.188835:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510416.188840:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb90ff3/0x3e734462ed655ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.188848:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb90ff3/0x3e734462ed655ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.188874:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bb90ff3/0x3e734462ed655ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.188881:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bb90ff3/0x3e734462ed655ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510416.188898:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510416.188900:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510416.188902:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788510416.188932:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929ab7d34700/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788510416.188937:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861046784:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788510417.156475:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510417.255317:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510417.255484:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852623104 00000100:00100000:3.0:1788510417.255496:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852623104 00000100:00100000:3.0:1788510417.255563:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 251 00000100:00100000:3.0:1788510417.255575:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:5585:x1875388852623104:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788510417.255594:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510417.255619:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a80031a00/0x3e734462ed655c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73202 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510417.255648:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a80031a00/0x3e734462ed655c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73202 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510417.255659:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a80031a00/0x3e734462ed655c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73202 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510417.255689:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a80031a00, rc 0) 00000100:00100000:3.0:1788510417.255834:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852623104:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 Request processed in 261us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510417.255841:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 251 00000100:00100000:2.0:1788510417.263715:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510417.263818:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852623232 00000100:00100000:1.0:1788510417.263830:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852623232 00000100:00100000:1.0:1788510417.263891:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 252 00000100:00100000:1.0:1788510417.263901:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852623232:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510417.264243:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852623232:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 Request processed in 321us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510417.264252:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 252 00000100:00100000:0.0:1788510417.267510:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510417.267607:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852623360 00000100:00100000:2.0:1788510417.267617:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852623360 00000100:00100000:2.0:1788510417.267677:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 253 00000100:00100000:2.0:1788510417.267686:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852623360:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510417.267927:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852623360:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 Request processed in 241us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510417.267935:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 253 00000100:00100000:2.0:1788510417.271832:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510417.271991:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852623488 00000100:00100000:3.0:1788510417.272004:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852623488 00000100:00100000:3.0:1788510417.272067:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 254 00000100:00100000:3.0:1788510417.272083:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:9943:x1875388852623488:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788510417.272359:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:9943:x1875388852623488:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 282us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510417.272367:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 254 00000100:00100000:0.0:1788510417.275701:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510417.292263:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852623616 00000100:00100000:1.0:1788510417.292280:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852623616 00000100:00100000:1.0:1788510417.292361:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 255 00000100:00100000:1.0:1788510417.292371:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:9943:x1875388852623616:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788510417.292675:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:9943:x1875388852623616:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 304us (16983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510417.292694:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 255 00000100:00100000:0.0:1788510417.303390:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510417.303504:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852623744 00000100:00100000:2.0:1788510417.303515:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852623744 00000100:00100000:2.0:1788510417.303579:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 256 00000100:00100000:2.0:1788510417.303589:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:5585:x1875388852623744:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510417.303607:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510417.303625:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929aaec76e00/0x3e734462ed655c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73209 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510417.303655:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929aaec76e00/0x3e734462ed655c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73209 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510417.303667:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929aaec76e00/0x3e734462ed655c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73209 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510417.303677:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76e00, rc 0) 00000100:00100000:2.0:1788510417.303819:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:5585:x1875388852623744:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 Request processed in 230us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510417.303827:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 256 00000100:00100000:2.0:1788510417.307550:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510417.310965:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852623872 00000100:00100000:3.0:1788510417.310981:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852623872 00000100:00100000:3.0:1788510417.311100:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 257 00000100:00100000:3.0:1788510417.311110:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:5585:x1875388852623872:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510417.311466:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:5585:x1875388852623872:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 Request processed in 356us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510417.311474:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 257 00000100:00100000:0.0:1788510417.315787:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510417.315881:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852624000 00000100:00100000:1.0:1788510417.315893:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852624000 00000100:00100000:1.0:1788510417.315959:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 258 00000100:00100000:1.0:1788510417.315970:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:5585:x1875388852624000:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510417.316258:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:5585:x1875388852624000:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 Request processed in 289us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510417.316265:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 258 00000100:00100000:0.0:1788510417.323343:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510417.323480:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852624128 00000100:00100000:3.0:1788510417.323490:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852624128 00000100:00100000:3.0:1788510417.323554:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 259 00000100:00100000:3.0:1788510417.323566:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:9946:x1875388852624128:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788510417.323834:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:9946:x1875388852624128:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 269us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510417.323854:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 259 00000100:00100000:3.0:1788510417.331160:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510417.331317:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852624256 00000100:00100000:2.0:1788510417.331327:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852624256 00000100:00100000:2.0:1788510417.331384:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 260 00000100:00100000:2.0:1788510417.331394:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:9946:x1875388852624256:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788510417.331663:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:9946:x1875388852624256:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 269us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510417.331672:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 260 00000100:00100000:1.0:1788510417.605100:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788510417.605127:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861046912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510417.605209:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510417.605563:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861046912 00000100:00100000:2.0:1788510417.605585:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861046912 00000100:00100000:2.0:1788510417.605650:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788510417.605660:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861046912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510417.605692:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510417.605735:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861046912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510417.605741:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788510417.606276:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788510417.606311:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaee5ca80 x1875388861046912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510417.606398:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861046912:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1788510417.732596:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788510417.732615:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929a85c6b800 from 7 10000000:01000000:2.0:1788510417.732620:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788510417.732673:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510417.732686:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510417.732698:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510417.732726:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788510417.732818:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510417.732879:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a83095e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788510417.733088:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861047040 00000100:00100000:1.0:1788510417.733098:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861047040 00000100:00100000:1.0:1788510417.733165:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788510417.733174:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+16:5818:x1875388861047040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788510417.733189:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510417.733204:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a83033600/0x3e734462ed655d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed655cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510417.733248:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83033600/0x3e734462ed655d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed655cf expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510417.733283:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a83033600/0x3e734462ed655d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed655cf expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510417.733294:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033600, rc 0) 00000100:00100000:1.0:1788510417.733345:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861047040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510417.733352:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788510417.733540:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510417.733560:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.733569:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510417.733646:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.733677:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510417.733704:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884f4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788510417.734490:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861047168 00000100:00100000:3.0:1788510417.734500:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861047168 00000100:00100000:3.0:1788510417.734547:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788510417.734556:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861047168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510417.734874:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861047168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510417.734881:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788510417.735937:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.735995:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.736060:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510417.736114:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884f4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788510417.736738:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861047296 00000100:00100000:1.0:1788510417.736746:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861047296 00000100:00100000:1.0:1788510417.736815:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788510417.736825:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861047296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510417.737048:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861047296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510417.737057:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788510417.737910:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.738982:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11656:1875388861047424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510417.739479:0:11656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510417.739898:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861047424 00000100:00100000:1.0:1788510417.739909:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861047424 00000100:00100000:1.0:1788510417.739964:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788510417.739974:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:11656:x1875388861047424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510417.740450:0:11656:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884f4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788510417.743323:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11656:1875388861047424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788510417.743393:0:11656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788510417.743409:0:11656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510417.743411:0:11656:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788510417.743418:0:11656:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff929a85c6b800 00000020:00000080:0.0:1788510417.743421:0:11656:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788510417.743557:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11656:1875388861047552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510417.743706:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:11656:x1875388861047424:12345-0@lo:502:llog_process_th.0 Request processed in 3731us (4225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510417.743719:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788510417.748871:0:11656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510417.748932:0:11656:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884f4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788510417.751143:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861047552 00000100:00100000:1.0:1788510417.751158:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861047552 00000100:00100000:1.0:1788510417.751257:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788510417.751268:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:11656:x1875388861047552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510417.751584:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+17:11656:x1875388861047552:12345-0@lo:502:llog_process_th.0 Request processed in 318us (2721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510417.751593:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788510417.752387:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11656:1875388861047552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788510417.752439:0:11656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788510417.752448:0:11656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510417.752451:0:11656:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788510417.752457:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788510417.754890:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788510417.754924:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788510417.754935:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510417.754949:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510417.754960:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788510417.754963:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929ab4b11000 from 7 10000000:01000000:1.0:1788510417.754966:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788510417.755007:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510417.755015:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510417.755026:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510417.755076:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788510417.755552:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510417.755596:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab5054a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788510417.755655:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861047680 00000100:00100000:0.0:1788510417.755663:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861047680 00000100:00100000:0.0:1788510417.755713:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788510417.755722:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+17:5818:x1875388861047680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510417.755736:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510417.755750:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eae600/0x3e734462ed655e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed655dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.755786:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eae600/0x3e734462ed655e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed655dd expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.755798:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eae600/0x3e734462ed655e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed655dd expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.755808:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae600, rc 0) 00000100:00100000:0.0:1788510417.755868:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861047680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510417.755874:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788510417.755918:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510417.755933:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.755943:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510417.755995:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.756022:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510417.756037:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884f4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788510417.756061:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861047808 00000100:00100000:0.0:1788510417.756065:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861047808 00000100:00100000:0.0:1788510417.756096:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788510417.756102:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861047808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.756773:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861047808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 666us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510417.756783:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788510417.756831:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.756865:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.756909:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510417.756925:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884f4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788510417.756940:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861047936 00000100:00100000:0.0:1788510417.756944:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861047936 00000100:00100000:0.0:1788510417.756973:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788510417.756981:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861047936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.757143:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861047936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510417.757150:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788510417.757189:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861047936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.757456:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11658:1875388861048064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510417.757491:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510417.757510:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861048064 00000100:00100000:0.0:1788510417.757514:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861048064 00000100:00100000:0.0:1788510417.757548:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788510417.757555:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:11658:x1875388861048064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510417.757687:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:11658:x1875388861048064:12345-0@lo:502:llog_process_th.0 Request processed in 132us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510417.757694:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788510417.757720:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a857c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788510417.757731:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11658:1875388861048064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788510417.757750:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788510417.757759:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510417.757762:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788510417.757768:0:11658:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff929ab4b11000 00000020:00000080:0.0:1788510417.757770:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788510417.757852:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11658:1875388861048192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510417.757885:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510417.757904:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861048192 00000100:00100000:0.0:1788510417.757914:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861048192 00000100:00100000:0.0:1788510417.757937:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788510417.757943:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:11658:x1875388861048192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510417.758040:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:11658:x1875388861048192:12345-0@lo:502:llog_process_th.0 Request processed in 97us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510417.758047:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788510417.758073:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a857c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788510417.758084:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11658:1875388861048192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788510417.758101:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788510417.758105:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510417.758106:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788510417.758110:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788510417.758158:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788510417.758173:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788510417.758184:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.758194:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510417.758204:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788510417.758206:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929a82ae6000 from 7 10000000:01000000:0.0:1788510417.758208:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788510417.758254:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.758262:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.758272:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510417.758290:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861048320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.758317:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510417.758331:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788510417.758343:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861048320 00000100:00100000:0.0:1788510417.758346:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861048320 00000100:00100000:0.0:1788510417.758366:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788510417.758372:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:5818:x1875388861048320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510417.758380:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510417.758392:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eaea00/0x3e734462ed655f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed655eb expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.758411:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eaea00/0x3e734462ed655f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed655eb expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.758421:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eaea00/0x3e734462ed655f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed655eb expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.758441:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaea00, rc 0) 00000100:00100000:0.0:1788510417.758467:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861048320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510417.758473:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788510417.758501:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861048320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510417.758515:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510417.758524:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510417.758573:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861048448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.758595:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510417.758607:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788510417.758618:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861048448 00000100:00100000:0.0:1788510417.758620:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861048448 00000100:00100000:0.0:1788510417.758638:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788510417.758644:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861048448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.758827:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861048448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510417.758833:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788510417.758859:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861048448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.758880:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861048576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.758909:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510417.758920:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788510417.758930:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861048576 00000100:00100000:0.0:1788510417.758933:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861048576 00000100:00100000:0.0:1788510417.758949:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788510417.758954:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861048576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.759050:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:5818:x1875388861048576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510417.759056:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788510417.759086:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:040cea51-0882-49ef-ac64-3cc6497ba05a:5818:1875388861048576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510417.759307:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11659:1875388861048704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510417.759344:0:11659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510417.759361:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861048704 00000100:00100000:0.0:1788510417.759365:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861048704 00000100:00100000:0.0:1788510417.759387:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788510417.759392:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:11659:x1875388861048704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510417.761387:0:11659:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a884f4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788510417.772005:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:11659:x1875388861048704:12345-0@lo:502:llog_process_th.0 Request processed in 12599us (12647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510417.772023:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788510417.772962:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11659:1875388861048704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788510417.773014:0:11659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510417.773036:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510417.773039:0:11659:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788510417.773049:0:11659:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff929a82ae6000 00000020:00000080:1.0:1788510417.773052:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788510417.773187:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11659:1875388861048832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510417.773460:0:11659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510417.773504:0:11659:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab5054780 going to sleep for 11 seconds 00000100:00100000:2.0:1788510417.773627:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861048832 00000100:00100000:2.0:1788510417.773635:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861048832 00000100:00100000:2.0:1788510417.773685:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788510417.773694:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:11659:x1875388861048832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510417.773906:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:11659:x1875388861048832:12345-0@lo:502:llog_process_th.0 Request processed in 213us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510417.773914:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788510417.774265:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:040cea51-0882-49ef-ac64-3cc6497ba05a:11659:1875388861048832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788510417.774294:0:11659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510417.774301:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510417.774304:0:11659:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788510417.774311:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788510417.775001:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788510417.775021:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788510417.775031:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510417.775052:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788510417.801668:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788510418.186867:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788510418.821286:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788510419.051260:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510419.051317:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510419.051372:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510419.051476:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852624640 00000100:00100000:3.0:1788510419.051486:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852624640 00000100:00100000:3.0:1788510419.051565:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 62 00000100:00100000:3.0:1788510419.051575:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852624640:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510419.051648:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852624640:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 74us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510419.051656:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 62 00000100:00080000:0.0:1788510419.052249:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788510419.052815:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852624512 00000100:00100000:2.0:1788510419.052825:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852624512 00000100:00100000:2.0:1788510419.052897:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 110 00000100:00100000:2.0:1788510419.052908:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2343:x1875388852624512:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510419.052970:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2343:x1875388852624512:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 64us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510419.052978:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 110 00000100:00100000:1.0:1788510419.053215:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852624384 00000100:00100000:1.0:1788510419.053247:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852624384 00000100:00100000:1.0:1788510419.053286:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 276 00000100:00100000:1.0:1788510419.053295:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2342:x1875388852624384:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510419.053331:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2342:x1875388852624384:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 37us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510419.053338:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 276 00000100:00100000:0.0:1788510419.053518:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00080000:0.0:1788510419.053633:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510419.053687:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852624768 00000100:00100000:3.0:1788510419.053692:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852624768 00000100:00100000:3.0:1788510419.053795:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 111 00000100:00100000:3.0:1788510419.053803:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2343:x1875388852624768:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510419.053841:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2343:x1875388852624768:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 39us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510419.053848:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 111 00000100:00080000:0.0:1788510419.054168:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788510419.204442:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510419.652613:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861049088:0@lo:400:kworker.0 00000100:00100000:1.0:1788510419.652613:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861049216:0@lo:400:kworker.0 00000100:00100000:3.0:1788510419.652705:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510419.652745:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861048960:0@lo:400:kworker.0 00000100:00100000:3.0:1788510419.652767:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861049600:0@lo:400:kworker.0 00000100:00100000:2.0:1788510419.652783:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510419.652850:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861049344:0@lo:400:kworker.0 00000100:00100000:3.0:1788510419.653180:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510419.653286:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861049088 00000100:00100000:3.0:1788510419.653294:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861049088 00000100:00100000:3.0:1788510419.653353:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788510419.653364:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861049088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510419.653456:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861049088:12345-0@lo:400:kworker.0 Request processed in 94us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510419.653465:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788510419.653512:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861049088:0@lo:400:kworker.0 00000100:00100000:3.0:1788510419.653550:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861048960 00000100:00100000:3.0:1788510419.653554:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861048960 00000100:00100000:3.0:1788510419.653581:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788510419.653588:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861048960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510419.653625:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861048960:12345-0@lo:400:kworker.0 Request processed in 37us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510419.653631:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788510419.653684:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861049600 00000100:00100000:3.0:1788510419.653688:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861049600 00000100:00100000:3.0:1788510419.653731:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788510419.653737:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861049600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510419.653775:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861049600:12345-0@lo:400:kworker.0 Request processed in 38us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510419.653782:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788510419.653824:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861049600:0@lo:400:kworker.0 00000100:00080000:3.0:1788510419.653865:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788510419.656305:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861048960:0@lo:400:kworker.0 00000100:00100000:2.0:1788510419.656324:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861049472:0@lo:400:kworker.0 00000100:00100000:2.0:1788510419.656390:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510419.657939:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861049472 00000100:00100000:3.0:1788510419.657955:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861049472 00000100:00100000:3.0:1788510419.658041:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788510419.658051:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861049472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510419.658133:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861049472:12345-0@lo:400:kworker.0 Request processed in 84us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510419.658140:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1788510419.658243:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510419.658281:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861049472:0@lo:400:kworker.0 00000100:00100000:1.0:1788510419.659037:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510419.664826:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861049216 00000100:00100000:3.0:1788510419.664851:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861049216 00000100:00100000:3.0:1788510419.664971:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788510419.664984:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861049216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510419.665087:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861049216:12345-0@lo:400:kworker.0 Request processed in 107us (6054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510419.665094:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788510419.665274:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861049216:0@lo:400:kworker.0 00000100:00080000:2.0:1788510419.665374:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510419.670562:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510419.670875:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861049344 00000100:00100000:3.0:1788510419.670889:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861049344 00000100:00100000:3.0:1788510419.670987:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788510419.670998:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861049344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510419.671081:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861049344:12345-0@lo:400:kworker.0 Request processed in 85us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510419.671089:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788510419.671208:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788510419.671317:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929ab7d36a00 x1875388861049344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510419.671334:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861049344:0@lo:400:kworker.0 00000100:00100000:3.0:1788510420.169150:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788510420.169187:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861049728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788510420.169290:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510420.169352:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861049728 00000100:00100000:2.0:1788510420.169360:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861049728 00000100:00100000:2.0:1788510420.169442:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788510420.169474:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861049728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788510420.169511:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510420.169565:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861049728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510420.169573:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788510420.169792:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861049728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788510420.229317:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510421.254945:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788510421.274749:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1788510422.276539:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510422.725782:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861049856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510422.725896:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510422.726083:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861049856 00000100:00100000:2.0:1788510422.726095:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861049856 00000100:00100000:2.0:1788510422.726187:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788510422.726201:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861049856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510422.726294:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510422.726361:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861049856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510422.726369:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788510422.727886:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788510422.727952:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaee5d500 x1875388861049856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510422.727998:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861049856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788510423.300604:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510424.168389:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510424.168441:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510424.168479:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510424.168514:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852624896 00000100:00100000:0.0:1788510424.168523:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510424.168527:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852624896 00000100:00100000:0.0:1788510424.168553:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852625024 00000100:00100000:0.0:1788510424.168557:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852625024 00000100:00100000:2.0:1788510424.168587:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 278 00000100:00100000:0.0:1788510424.168592:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852625280 00000100:00100000:0.0:1788510424.168595:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852625280 00000100:00100000:2.0:1788510424.168596:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852624896:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510424.168636:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 115 00000100:00100000:0.0:1788510424.168642:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2340:x1875388852625024:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510424.168669:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852624896:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 74us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510424.168669:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2340:x1875388852625024:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510424.168677:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 278 00000100:00100000:0.0:1788510424.168678:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 115 00000100:00100000:0.0:1788510424.168692:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 116 00000100:00100000:0.0:1788510424.168697:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852625280:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510424.168736:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852625280:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 37us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510424.168742:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 116 00000100:00100000:1.0:1788510424.172159:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852625152 00000100:00100000:1.0:1788510424.172181:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852625152 00000100:00100000:1.0:1788510424.172351:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 65 00000100:00100000:1.0:1788510424.172366:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852625152:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510424.172458:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852625152:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 97us (3978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510424.172467:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 65 00000100:00080000:1.0:1788510424.172493:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510424.172498:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788510424.324734:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510424.772719:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861050240:0@lo:400:kworker.0 00000100:00100000:1.0:1788510424.772803:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510424.772888:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788510424.772896:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861050112:0@lo:400:kworker.0 00000100:00100000:3.0:1788510424.773029:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861049984:0@lo:400:kworker.0 00000100:00100000:3.0:1788510424.773076:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510424.773106:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861050496:0@lo:400:kworker.0 00000100:00100000:3.0:1788510424.773139:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861049984 00000100:00100000:3.0:1788510424.773146:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861049984 00000100:00100000:3.0:1788510424.773197:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788510424.773268:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861049984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510424.773365:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861049984:12345-0@lo:400:kworker.0 Request processed in 158us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510424.773372:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788510424.773742:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510424.773780:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861050624:0@lo:400:kworker.0 00000100:00100000:1.0:1788510424.773821:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510424.774342:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861050368:0@lo:400:kworker.0 00000100:00100000:0.0:1788510424.774383:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510424.774445:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861050240 00000100:00100000:0.0:1788510424.774452:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861050240 00000100:00100000:0.0:1788510424.774501:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861050112 00000100:00100000:0.0:1788510424.774505:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861050112 00000100:00100000:0.0:1788510424.774528:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788510424.774536:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861050240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510424.774584:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861050240:12345-0@lo:400:kworker.0 Request processed in 48us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510424.774592:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788510424.774604:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861050624 00000100:00100000:0.0:1788510424.774605:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788510424.774609:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861050624 00000100:00100000:0.0:1788510424.774611:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861050112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510424.774636:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861050368 00000100:00100000:1.0:1788510424.774639:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861050368 00000100:00100000:0.0:1788510424.774639:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861050112:12345-0@lo:400:kworker.0 Request processed in 29us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510424.774654:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788510424.774657:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788510424.774663:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861050624:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788510424.774674:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788510424.774677:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788510424.774680:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510424.774694:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861050624:12345-0@lo:400:kworker.0 Request processed in 32us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510424.774701:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788510424.774712:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788510424.774712:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861050112:0@lo:400:kworker.0 00000100:00100000:1.0:1788510424.774717:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861050368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510424.774723:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788510424.774728:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff929ab7d34700, transno 4294967300 00000100:00100000:0.0:1788510424.774739:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861050624:0@lo:400:kworker.0 00000100:00100000:1.0:1788510424.774745:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861050368:12345-0@lo:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510424.774750:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861050240:0@lo:400:kworker.0 00000100:00100000:1.0:1788510424.774751:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1788510424.774789:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abac0c000 x1875388861050368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510424.774799:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861050368:0@lo:400:kworker.0 00000100:00100000:3.0:1788510424.775551:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510424.775648:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861049984:0@lo:400:kworker.0 00000100:00100000:1.0:1788510424.775789:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861050496 00000100:00100000:1.0:1788510424.775799:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861050496 00000100:00100000:1.0:1788510424.775855:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788510424.775864:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861050496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510424.776059:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861050496:12345-0@lo:400:kworker.0 Request processed in 195us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510424.776067:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1788510424.776159:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510424.776208:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861050496:0@lo:400:kworker.0 00000100:00100000:2.0:1788510425.286314:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861050752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510425.286404:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510425.286545:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861050752 00000100:00100000:0.0:1788510425.286558:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861050752 00000100:00100000:0.0:1788510425.286613:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788510425.286622:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861050752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788510425.286661:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510425.288403:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861050752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1770us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510425.288419:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788510425.291194:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861050752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788510425.349084:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510426.372476:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510427.403800:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510427.846961:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861050880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788510427.847041:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510427.847189:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861050880 00000100:00100000:1.0:1788510427.847198:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861050880 00000100:00100000:1.0:1788510427.847294:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788510427.847306:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861050880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788510427.847350:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788510427.848486:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510427.852403:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861050880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5087us (5349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510427.852419:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788510427.854788:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaee5d500 x1875388861050880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510427.854965:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861050880:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788510428.036919:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788510428.420757:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510429.284370:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510429.284417:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510429.284454:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510429.284587:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852625408 00000100:00100000:2.0:1788510429.284598:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852625408 00000100:00100000:2.0:1788510429.284728:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 280 00000100:00100000:2.0:1788510429.284740:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852625408:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510429.284829:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852625408:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 92us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510429.284836:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 280 00000100:00100000:0.0:1788510429.287457:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510429.288353:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852625664 00000100:00100000:2.0:1788510429.288370:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852625664 00000100:00100000:2.0:1788510429.288466:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 68 00000100:00100000:2.0:1788510429.288478:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852625664:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510429.288568:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852625664:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 92us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510429.288576:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 68 00000100:00080000:0.0:1788510429.289582:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788510429.290063:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852625536 00000100:00100000:3.0:1788510429.290073:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852625536 00000100:00100000:3.0:1788510429.290179:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852625792 00000100:00100000:3.0:1788510429.290184:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852625792 00000100:00100000:2.0:1788510429.290270:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 120 00000100:00100000:2.0:1788510429.290282:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2340:x1875388852625536:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510429.290376:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2340:x1875388852625536:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 96us (6030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510429.290384:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 120 00000100:00080000:0.0:1788510429.294407:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510429.297730:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 121 00000100:00100000:2.0:1788510429.297758:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852625792:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510429.297881:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852625792:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 136us (13425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510429.297890:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 121 00010000:00010000:2.0:1788510429.444751:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510429.892452:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510429.892481:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861051008:0@lo:400:kworker.0 00000100:00100000:2.0:1788510429.892491:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861051136:0@lo:400:kworker.0 00000100:00100000:0.0:1788510429.892545:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861051264:0@lo:400:kworker.0 00000100:00100000:2.0:1788510429.892589:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510429.892634:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510429.892661:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861051648:0@lo:400:kworker.0 00000100:00100000:3.0:1788510429.892730:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861051520:0@lo:400:kworker.0 00000100:00100000:2.0:1788510429.893676:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510429.893750:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861051648 00000100:00100000:2.0:1788510429.893758:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861051648 00000100:00100000:0.0:1788510429.893875:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861051136 00000100:00100000:0.0:1788510429.893881:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861051136 00000100:00100000:0.0:1788510429.893909:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861051264 00000100:00100000:0.0:1788510429.893912:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861051264 00000100:00100000:0.0:1788510429.893929:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788510429.893936:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861051136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510429.894007:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861051136:12345-0@lo:400:kworker.0 Request processed in 70us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510429.894014:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788510429.894032:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788510429.894038:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861051264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510429.894068:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861051264:12345-0@lo:400:kworker.0 Request processed in 32us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510429.894072:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788510429.894104:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861051264:0@lo:400:kworker.0 00000100:00080000:0.0:1788510429.894120:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788510429.894142:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788510429.894156:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861051136:0@lo:400:kworker.0 00000100:00100000:2.0:1788510429.894213:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788510429.894247:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861051648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510429.894400:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861051648:12345-0@lo:400:kworker.0 Request processed in 178us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510429.894408:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788510429.894426:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861051648:0@lo:400:kworker.0 00000100:00100000:1.0:1788510429.897385:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510429.897398:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510429.897458:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861051520 00000100:00100000:0.0:1788510429.897469:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861051520 00000100:00100000:1.0:1788510429.897481:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861051392:0@lo:400:kworker.0 00000100:00100000:1.0:1788510429.897536:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510429.897537:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788510429.897546:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861051520:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788510429.897584:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510429.897645:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861051008 00000100:00100000:2.0:1788510429.897649:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861051008 00000100:00100000:2.0:1788510429.897777:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788510429.897786:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861051008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510429.898105:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861051008:12345-0@lo:400:kworker.0 Request processed in 320us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510429.898113:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788510429.898193:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861051392 00000100:00100000:2.0:1788510429.898197:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861051392 00000100:00100000:1.0:1788510429.898268:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861051008:0@lo:400:kworker.0 00000100:00080000:1.0:1788510429.898300:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510429.898300:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861051520:12345-0@lo:400:kworker.0 Request processed in 754us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510429.898307:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788510429.898329:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861051520:0@lo:400:kworker.0 00000100:00100000:2.0:1788510429.898368:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788510429.898376:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861051392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510429.898448:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861051392:12345-0@lo:400:kworker.0 Request processed in 74us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510429.898453:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788510429.898551:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a98430000 x1875388861051392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510429.898560:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861051392:0@lo:400:kworker.0 00000100:00100000:2.0:1788510430.404700:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788510430.405958:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861051776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510430.406060:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510430.406313:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861051776 00000100:00100000:3.0:1788510430.406325:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861051776 00000100:00100000:3.0:1788510430.406492:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788510430.406523:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861051776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788510430.406577:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510430.406664:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861051776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510430.406672:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788510430.406779:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861051776:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788510430.470125:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510431.493914:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510432.518636:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510432.968815:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861051904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510432.968928:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510432.969378:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861051904 00000100:00100000:2.0:1788510432.969389:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861051904 00000100:00100000:2.0:1788510432.969468:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788510432.969479:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861051904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510432.969516:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510432.969586:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861051904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510432.969593:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788510432.969679:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a87e3ed80 x1875388861051904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510432.969702:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861051904:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788510432.971389:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788510433.541507:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510434.406031:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510434.406085:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510434.406191:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852626048 00000100:00100000:0.0:1788510434.406201:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852626048 00000100:00100000:0.0:1788510434.406306:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 125 00000100:00100000:0.0:1788510434.406318:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852626048:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510434.406395:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852626048:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 80us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510434.406403:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 125 00000100:00080000:2.0:1788510434.406951:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510434.407064:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852625920 00000100:00100000:3.0:1788510434.407070:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852625920 00000100:00100000:3.0:1788510434.407112:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 282 00000100:00100000:3.0:1788510434.407121:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852625920:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510434.407174:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852625920:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 54us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510434.407182:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 282 00000100:00100000:2.0:1788510434.422958:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510434.423010:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510434.423094:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852626176 00000100:00100000:3.0:1788510434.423104:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852626176 00000100:00100000:3.0:1788510434.423191:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:3.0:1788510434.423202:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2339:x1875388852626176:12345-192.168.201.4@tcp:9:kworker.0 00000020:00000080:3.0:1788510434.423267:0:6670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed6552e 00000100:00080000:3.0:1788510434.423277:0:6670:0:(import.c:65:import_set_state_nolock()) ffff929a830fe000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788510434.423319:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1788510434.423625:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788510434.423656:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510434.423942:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852626304 00000100:00100000:1.0:1788510434.423949:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852626304 00000100:00100000:1.0:1788510434.424001:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 126 00000100:00100000:1.0:1788510434.424010:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852626304:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510434.424067:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+2:2339:x1875388852626176:12345-192.168.201.4@tcp:9:kworker.0 Request processed in 867us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510434.424076:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00080000:3.0:1788510434.424111:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510434.425242:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852626304:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 1215us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510434.425253:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 126 00010000:00010000:3.0:1788510434.568410:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510435.017964:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861052160:0@lo:400:kworker.0 00000100:00100000:2.0:1788510435.018043:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510435.018109:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861052672:0@lo:400:kworker.0 00000100:00100000:2.0:1788510435.018146:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510435.018178:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788510435.018183:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861052288:0@lo:400:kworker.0 00000100:00100000:2.0:1788510435.018204:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510435.018274:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861052160 00000100:00100000:2.0:1788510435.018298:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861052160 00000100:00100000:2.0:1788510435.018343:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861052288 00000100:00100000:2.0:1788510435.018347:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861052288 00000100:00100000:2.0:1788510435.018377:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788510435.018386:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861052160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510435.018625:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861052160:12345-0@lo:400:kworker.0 Request processed in 238us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510435.018634:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788510435.018674:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861052160:0@lo:400:kworker.0 00000100:00100000:2.0:1788510435.018701:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788510435.018708:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861052288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510435.018741:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861052288:12345-0@lo:400:kworker.0 Request processed in 34us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510435.018747:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788510435.018769:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861052288:0@lo:400:kworker.0 00000100:00080000:3.0:1788510435.018893:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510435.019066:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861052416:0@lo:400:kworker.0 00000100:00100000:1.0:1788510435.019099:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510435.019139:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788510435.019147:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861052032:0@lo:400:kworker.0 00000100:00100000:1.0:1788510435.019176:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510435.019213:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861052544:0@lo:400:kworker.0 00000100:00100000:1.0:1788510435.019272:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510435.019307:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861052544 00000100:00100000:1.0:1788510435.019312:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861052544 00000100:00100000:1.0:1788510435.019346:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788510435.019353:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861052544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510435.019390:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861052544:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510435.019409:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788510435.019450:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861052544:0@lo:400:kworker.0 00000100:00100000:0.0:1788510435.019599:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861052672 00000100:00100000:0.0:1788510435.019605:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861052672 00000100:00100000:0.0:1788510435.019647:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861052416 00000100:00100000:0.0:1788510435.019651:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861052416 00000100:00100000:0.0:1788510435.019673:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788510435.019681:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861052672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510435.019730:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861052672:12345-0@lo:400:kworker.0 Request processed in 50us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510435.019737:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788510435.019750:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788510435.019757:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861052416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510435.019789:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861052416:12345-0@lo:400:kworker.0 Request processed in 33us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510435.019795:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788510435.019834:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a87e3fb80 x1875388861052416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510435.019845:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861052416:0@lo:400:kworker.0 00000100:00100000:3.0:1788510435.019934:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861052032 00000100:00100000:3.0:1788510435.019939:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861052032 00000100:00100000:3.0:1788510435.019975:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788510435.019983:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861052032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510435.020020:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861052032:12345-0@lo:400:kworker.0 Request processed in 38us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510435.020026:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:3.0:1788510435.020051:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788510435.020054:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788510435.020056:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510435.020380:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861052032:0@lo:400:kworker.0 00000100:00100000:2.0:1788510435.025865:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861052672:0@lo:400:kworker.0 00000100:00100000:2.0:1788510435.524558:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788510435.524583:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861052800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510435.524659:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510435.524753:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861052800 00000100:00100000:2.0:1788510435.524773:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861052800 00000100:00100000:2.0:1788510435.524832:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788510435.524842:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861052800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788510435.524889:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510435.524945:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861052800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510435.524967:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788510435.525281:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861052800:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788510435.591323:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510436.614820:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788510436.668148:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000020:00000080:1.0:1788510436.668160:0:7621:0:(genops.c:885:class_export_put()) final put ffff929a830ff800/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000020:00000080:0.0:1788510436.668402:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929a830ff800/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f for lustre-OST0001 00000020:00000080:0.0:1788510436.668634:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929a830fe000 for lustre-OST0001 00010000:00010000:2.0:1788510437.638737:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510438.086318:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788510438.086351:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861052928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510438.086448:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510438.086933:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861052928 00000100:00100000:2.0:1788510438.086944:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861052928 00000100:00100000:2.0:1788510438.087019:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788510438.087030:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861052928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510438.087071:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510438.087138:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861052928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510438.087145:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788510438.087277:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a87e3e680 x1875388861052928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510438.087299:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861052928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788510438.087758:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788510438.279908:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788510438.660562:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510439.541673:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510439.541739:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510439.541783:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510439.544176:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852626432 00000100:00100000:2.0:1788510439.544197:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852626432 00000100:00100000:2.0:1788510439.544330:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 284 00000100:00100000:2.0:1788510439.544343:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2340:x1875388852626432:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510439.544435:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2340:x1875388852626432:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 94us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510439.544443:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 284 00000100:00100000:0.0:1788510439.546154:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852626688 00000100:00100000:0.0:1788510439.546170:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852626688 00000100:00100000:0.0:1788510439.546378:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852626560 00000100:00100000:0.0:1788510439.546391:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852626560 00000100:00100000:2.0:1788510439.546473:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 130 00000100:00100000:2.0:1788510439.546491:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852626688:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510439.546618:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852626688:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 132us (4877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510439.546627:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 130 00000100:00080000:1.0:1788510439.551450:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510439.554084:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 131 00000100:00100000:0.0:1788510439.554111:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2340:x1875388852626560:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510439.555377:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2340:x1875388852626560:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 1266us (13579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510439.555401:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 131 00010000:00010000:2.0:1788510439.684518:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510440.136583:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861053440:0@lo:400:kworker.0 00000100:00100000:0.0:1788510440.136671:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510440.136727:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788510440.136733:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861053056:0@lo:400:kworker.0 00000100:00100000:0.0:1788510440.136762:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510440.136785:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861053568:0@lo:400:kworker.0 00000100:00100000:0.0:1788510440.136808:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510440.136834:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861053184:0@lo:400:kworker.0 00000100:00100000:0.0:1788510440.136855:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510440.136873:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861053696:0@lo:400:kworker.0 00000100:00100000:0.0:1788510440.136893:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510440.136910:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788510440.136915:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861053312:0@lo:400:kworker.0 00000100:00100000:0.0:1788510440.136933:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510440.136961:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861053440 00000100:00100000:0.0:1788510440.136968:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861053440 00000100:00100000:0.0:1788510440.137023:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861053696 00000100:00100000:0.0:1788510440.137027:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861053696 00000100:00100000:0.0:1788510440.137062:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788510440.137071:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861053440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510440.137125:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861053440:12345-0@lo:400:kworker.0 Request processed in 55us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510440.137133:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788510440.137256:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788510440.137267:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861053696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510440.137308:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861053696:12345-0@lo:400:kworker.0 Request processed in 45us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510440.137315:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788510440.137335:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510440.137339:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510440.137367:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861053696:0@lo:400:kworker.0 00000100:00100000:1.0:1788510440.137412:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861053568 00000100:00100000:1.0:1788510440.137416:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861053568 00000100:00100000:1.0:1788510440.137446:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861053184 00000100:00100000:1.0:1788510440.137449:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861053184 00000100:00100000:1.0:1788510440.137461:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861053312 00000100:00100000:1.0:1788510440.137463:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861053312 00000100:00100000:1.0:1788510440.137476:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788510440.137482:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861053568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510440.137514:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861053568:12345-0@lo:400:kworker.0 Request processed in 32us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510440.137520:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788510440.137533:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788510440.137537:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861053184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510440.137566:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861053184:12345-0@lo:400:kworker.0 Request processed in 28us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510440.137571:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788510440.137592:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788510440.137598:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861053312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510440.137625:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861053312:12345-0@lo:400:kworker.0 Request processed in 27us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510440.137630:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788510440.137651:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861053056 00000100:00100000:1.0:1788510440.137655:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861053056 00000100:00100000:1.0:1788510440.137679:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788510440.137685:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861053056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510440.137712:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861053056:12345-0@lo:400:kworker.0 Request processed in 28us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510440.137718:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:1.0:1788510440.137746:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510440.137764:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861053312:0@lo:400:kworker.0 00000100:00100000:1.0:1788510440.137774:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861053184:0@lo:400:kworker.0 00000100:00100000:1.0:1788510440.137824:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861053056:0@lo:400:kworker.0 00000100:00100000:1.0:1788510440.137833:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861053568:0@lo:400:kworker.0 00010000:00080000:1.0:1788510440.137843:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a98432300 x1875388861053440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510440.137852:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861053440:0@lo:400:kworker.0 00000100:00100000:0.0:1788510440.644600:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861053824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510440.644772:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510440.646233:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861053824 00000100:00100000:3.0:1788510440.646247:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861053824 00000100:00100000:3.0:1788510440.646314:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788510440.646325:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861053824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788510440.646367:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510440.652852:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861053824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6508us (8059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510440.652873:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788510440.664303:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861053824:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788510440.714015:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788510441.057731:0:11827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:27:19 (1788510439) 00010000:00010000:2.0:1788510441.732596:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510442.759172:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510443.204526:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861053952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510443.204609:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510443.204811:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861053952 00000100:00100000:2.0:1788510443.204824:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861053952 00000100:00100000:2.0:1788510443.204963:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788510443.204974:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861053952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510443.205026:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510443.205083:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861053952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510443.205090:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788510443.205131:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a87e3ce00 x1875388861053952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510443.205160:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861053952:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788510443.207736:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510443.416977:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510443.428662:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852626816 00000100:00100000:1.0:1788510443.428697:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852626816 00000100:00080000:2.0:1788510443.428807:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510443.428837:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 32 00000100:00100000:1.0:1788510443.428850:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:10215:x1875388852626816:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788510443.428875:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510443.428899:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed655f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.428976:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65600 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.429003:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.429018:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510443.429057:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788510443.429061:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510443.429098:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.429126:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed655f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73210 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.429145:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65600 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73210 expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.429155:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:1.0:1788510443.429157:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788510443.429161:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033c00, rc 0) 00000100:00100000:1.0:1788510443.429295:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:10215:x1875388852626816:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 448us (12328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510443.429302:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 32 00000100:00100000:1.0:1788510443.436054:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510443.436308:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852626944 00000100:00100000:0.0:1788510443.436320:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852626944 00000100:00100000:0.0:1788510443.436384:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00100000:0.0:1788510443.436395:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:10216:x1875388852626944:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788510443.436645:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510443.436672:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65607 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73217 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.436740:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6560e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.436753:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6560e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.436764:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6560e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.436777:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65615 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.436784:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.436789:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.437035:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed6561c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.437043:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed6561c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.437057:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed6561c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510443.437087:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788510443.437090:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788510443.437112:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed6561c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.437123:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6560e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.437131:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6560e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.437137:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6560e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.437155:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaec00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510443.437160:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6560e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.437168:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6560e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438082:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:0.0:1788510443.438090:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510443.438096:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6560e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438106:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6560e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438137:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438637:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65615 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438646:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65615 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438651:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510443.438655:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65615 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438661:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65615 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438672:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff929a8b8f5600) 00010000:00010000:0.0:1788510443.438674:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510443.438678:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65615 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438684:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65615 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438732:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65607 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73217 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438747:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed6561c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73217 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510443.438767:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff929a8b8f5500) 00010000:00010000:0.0:1788510443.438769:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788510443.438772:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaee00, rc 0) 00000100:00100000:0.0:1788510443.438856:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:10216:x1875388852626944:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 2462us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510443.438864:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00100000:3.0:1788510443.448201:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510443.448308:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852627200 00000100:00100000:1.0:1788510443.448321:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852627200 00000100:00100000:1.0:1788510443.448394:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 34 00000100:00100000:1.0:1788510443.448404:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:10216:x1875388852627200:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788510443.448431:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510443.448451:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65623 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7321e expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.448531:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6562a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.448547:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6562a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.448560:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6562a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.448628:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65631 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.448637:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65631 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.448644:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65631 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.448996:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032e00/0x3e734462ed65638 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449012:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032e00/0x3e734462ed65638 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449020:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032e00/0x3e734462ed65638 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510443.449032:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788510443.449193:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6562a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449201:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6562a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449208:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6562a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449215:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510443.449220:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6562a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449261:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6562a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449274:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff929a8b8f5500) 00010000:00010000:1.0:1788510443.449277:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510443.449282:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6562a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449289:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6562a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449301:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65631 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449312:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65631 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449318:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65631 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449322:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510443.449325:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65631 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449331:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65631 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449338:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff929a82b92a00) 00010000:00010000:1.0:1788510443.449341:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510443.449343:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65631 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449348:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65631 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449801:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65623 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7321e expref: 10 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449817:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032e00/0x3e734462ed65638 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7321e expref: 9 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510443.449826:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:1.0:1788510443.449828:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510443.449836:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032e00, rc 0) 00000100:00100000:1.0:1788510443.461434:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:10216:x1875388852627200:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 13004us (13220us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788510443.461452:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 34 00000100:00100000:3.0:1788510443.468567:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510443.468994:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852627328 00000100:00100000:1.0:1788510443.469004:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852627328 00000100:00100000:1.0:1788510443.469063:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 35 00000100:00100000:1.0:1788510443.469074:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:10216:x1875388852627328:12345-192.168.201.4@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788510443.469172:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:10216:x1875388852627328:12345-192.168.201.4@tcp:59:lhsmtool_posix.0 Request processed in 99us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510443.469188:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 35 00010000:00010000:2.0:1788510443.782952:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788510444.427576:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788510444.651489:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510444.651535:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510444.651573:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510444.651652:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852627456 00000100:00100000:3.0:1788510444.651663:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852627456 00000100:00100000:0.0:1788510444.651700:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852627584 00000100:00100000:0.0:1788510444.651705:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852627584 00000100:00100000:3.0:1788510444.651716:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 286 00000100:00100000:3.0:1788510444.651726:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852627456:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510444.651735:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852627712 00000100:00100000:0.0:1788510444.651738:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852627712 00000100:00100000:0.0:1788510444.651762:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 135 00000100:00100000:0.0:1788510444.651769:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2340:x1875388852627584:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510444.651795:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852627456:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 70us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510444.651797:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2340:x1875388852627584:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 29us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510444.651802:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 286 00000100:00100000:0.0:1788510444.651803:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 135 00000100:00100000:0.0:1788510444.651817:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 136 00000100:00100000:0.0:1788510444.651822:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852627712:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510444.651841:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852627712:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 19us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510444.651846:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 136 00000100:00080000:2.0:1788510444.652117:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788510444.804568:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510445.260434:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861054208:0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.260511:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510445.260564:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861054720:0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.260589:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510445.260619:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788510445.260624:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861054336:0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.260645:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510445.260688:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861054208 00000100:00100000:1.0:1788510445.260696:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861054208 00000100:00100000:1.0:1788510445.260740:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861054336 00000100:00100000:1.0:1788510445.260743:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861054336 00000100:00100000:1.0:1788510445.260774:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788510445.260790:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861054208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.260848:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861054208:12345-0@lo:400:kworker.0 Request processed in 59us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.260856:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788510445.260872:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788510445.260878:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861054336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.260904:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861054336:12345-0@lo:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.260909:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788510445.260925:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861054720 00000100:00100000:1.0:1788510445.260929:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861054720 00000100:00100000:1.0:1788510445.260966:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788510445.260973:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861054720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.261001:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861054720:12345-0@lo:400:kworker.0 Request processed in 29us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.261007:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788510445.261028:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510445.261032:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510445.261063:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861054336:0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.261073:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861054208:0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.261081:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861054720:0@lo:400:kworker.0 00000100:00100000:3.0:1788510445.261156:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861054080:0@lo:400:kworker.0 00000100:00100000:3.0:1788510445.261190:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510445.261248:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861054592:0@lo:400:kworker.0 00000100:00100000:3.0:1788510445.261270:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510445.261286:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788510445.261291:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861054464:0@lo:400:kworker.0 00000100:00100000:3.0:1788510445.261311:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510445.261721:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861054080 00000100:00100000:1.0:1788510445.261726:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861054080 00000100:00100000:1.0:1788510445.261765:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788510445.261772:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861054080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.261828:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3289:x1875388861054080:12345-0@lo:400:kworker.0 Request processed in 56us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.261835:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788510445.261863:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861054464 00000100:00100000:1.0:1788510445.261866:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861054464 00000100:00100000:1.0:1788510445.261896:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788510445.261901:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861054464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.261930:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861054464:12345-0@lo:400:kworker.0 Request processed in 29us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.261935:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788510445.261961:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788510445.261989:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929abac0fb80 x1875388861054464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788510461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510445.262001:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861054464:0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.262009:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861054080:0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.262036:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861054592 00000100:00100000:1.0:1788510445.262039:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861054592 00000100:00100000:1.0:1788510445.262065:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788510445.262070:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861054592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510445.262103:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861054592:12345-0@lo:400:kworker.0 Request processed in 33us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.262109:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1788510445.262122:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510445.262137:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861054592:0@lo:400:kworker.0 00000100:00100000:0.0:1788510445.477086:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510445.478800:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852627840 00000100:00100000:1.0:1788510445.478825:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852627840 00000100:00080000:0.0:1788510445.478962:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510445.479036:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 36 00000100:00100000:1.0:1788510445.479049:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:10259:x1875388852627840:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510445.479076:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510445.479099:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65646 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73225 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479497:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6564d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479524:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6564d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479538:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6564d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479555:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65654 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479564:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479571:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479756:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6564d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479764:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6564d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479771:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6564d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479778:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510445.479783:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6564d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479790:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6564d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479802:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:0.0:1788510445.479810:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510445.479815:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6564d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479821:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6564d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479832:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479838:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65654 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479843:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65654 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479849:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510445.479852:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65654 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479858:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65654 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479865:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff929a8b8f5600) 00010000:00010000:0.0:1788510445.479868:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510445.479871:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65654 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479876:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65654 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479921:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65646 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73225 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479942:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:0.0:1788510445.479945:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510445.479959:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65646 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73225 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.479970:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033000, rc 0) 00000100:00100000:0.0:1788510445.480053:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:10259:x1875388852627840:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 1007us (2975us total) trans 0 rc 301/301 00000100:00100000:0.0:1788510445.480060:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 36 00000100:00100000:3.0:1788510445.486354:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510445.486525:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852628096 00000100:00100000:1.0:1788510445.486540:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852628096 00000100:00100000:1.0:1788510445.486625:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 37 00000100:00100000:1.0:1788510445.486638:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:10259:x1875388852628096:12345-192.168.201.4@tcp:36:lfs.0 00010000:00010000:1.0:1788510445.486719:0:9544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510445.486747:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65600 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73210 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.486773:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:1.0:1788510445.486784:0:9544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788510445.487060:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6565b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.487073:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6565b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.487084:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6565b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.487095:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65662 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.487544:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65662 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.487565:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65662 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510445.489665:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788510445.489686:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6565b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.489696:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6565b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.489704:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6565b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.489710:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510445.489715:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6565b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.489724:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6565b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.489743:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a82b92600) 00010000:00010000:1.0:1788510445.489747:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510445.489753:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6565b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.489759:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6565b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788510445.489783:0:9544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059da2613 reply state 00000000afa84650 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65662 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510445.489803:0:9544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788510445.489935:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:10259:x1875388852628096:12345-192.168.201.4@tcp:36:lfs.0 Request processed in 3296us (3595us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788510445.489944:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 37 00010000:00010000:0.0:1788510445.498847:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65662 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.498867:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65662 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.498876:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65662 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.498883:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510445.498888:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65662 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.498896:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65662 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.498915:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff929a82b92800) 00010000:00010000:0.0:1788510445.498918:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510445.498923:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65662 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.498939:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65662 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510445.586213:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510445.586395:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852628224 00000100:00100000:2.0:1788510445.586407:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852628224 00000100:00100000:2.0:1788510445.586461:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 38 00000100:00100000:2.0:1788510445.586472:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:10267:x1875388852628224:12345-192.168.201.4@tcp:101:lctl.0 00010000:00010000:2.0:1788510445.586497:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510445.586518:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7322c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.586585:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65670 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.586735:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.586746:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510445.586795:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788510445.586798:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510445.586840:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.586863:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7322c expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.586883:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65670 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7322c expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.586892:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:2.0:1788510445.586895:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510445.586899:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77e00, rc 0) 00000100:00100000:2.0:1788510445.586981:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:10267:x1875388852628224:12345-192.168.201.4@tcp:101:lctl.0 Request processed in 509us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510445.586988:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 38 00000100:00100000:1.0:1788510445.646085:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510445.646202:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852628352 00000100:00100000:3.0:1788510445.646213:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852628352 00000100:00100000:3.0:1788510445.646316:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 39 00000100:00100000:3.0:1788510445.646327:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:10273:x1875388852628352:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:3.0:1788510445.646348:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510445.646370:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed65677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73233 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646438:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed6567e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646456:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed6567e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646468:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed6567e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646484:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65685 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646521:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646528:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646617:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a81532200/0x3e734462ed6568c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646626:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a81532200/0x3e734462ed6568c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646633:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a81532200/0x3e734462ed6568c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510445.646660:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788510445.646663:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510445.646705:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a81532200/0x3e734462ed6568c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646718:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed6567e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646725:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed6567e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646731:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed6567e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646737:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80031600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510445.646742:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed6567e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646756:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed6567e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646769:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:3.0:1788510445.646772:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510445.646778:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed6567e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.646785:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a80031600/0x3e734462ed6567e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.647571:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.647585:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65685 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.647591:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65685 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.647596:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80030a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510445.647599:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65685 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.647606:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65685 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.647618:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff929a83eab200) 00010000:00010000:3.0:1788510445.647621:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510445.647624:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65685 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.647649:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030a00/0x3e734462ed65685 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.647702:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a80030c00/0x3e734462ed65677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73233 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.647718:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a81532200/0x3e734462ed6568c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73233 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.647726:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:3.0:1788510445.647729:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788510445.647733:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a81532200, rc 0) 00000100:00100000:2.0:1788510445.649083:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:10273:x1875388852628352:12345-192.168.201.4@tcp:101:bash.0 Request processed in 2748us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510445.649096:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 39 00000100:00100000:3.0:1788510445.657394:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510445.663055:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852628608 00000100:00100000:0.0:1788510445.663073:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852628608 00000100:00100000:0.0:1788510445.663142:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 40 00000100:00100000:0.0:1788510445.663151:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:10273:x1875388852628608:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:0.0:1788510445.663172:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510445.663196:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65693 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7323a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.663363:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6569a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.663387:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6569a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.663398:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6569a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.663458:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed656a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.663466:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed656a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.663473:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed656a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788510445.664083:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788510445.664318:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed656a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.664330:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed656a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.664340:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed656a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.664378:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6569a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.664385:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6569a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.664392:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6569a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.664398:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510445.664402:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6569a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.664409:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6569a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.664421:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:0.0:1788510445.664424:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510445.664429:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6569a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.664435:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed6569a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510445.664458:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0516534 reply state 00000000bdc69647 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed656a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510445.664467:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788510445.664501:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65693 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7323a expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.664517:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed656a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7323a expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.664526:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a8b8f5300) 00010000:00010000:0.0:1788510445.664528:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510445.664531:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaec00, rc 0) 00000100:00100000:0.0:1788510445.664606:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:10273:x1875388852628608:12345-192.168.201.4@tcp:101:bash.0 Request processed in 1455us (7381us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788510445.664615:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 40 00000100:00100000:0.0:1788510445.672466:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510445.672546:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852628736 00000100:00100000:1.0:1788510445.672556:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852628736 00000100:00100000:1.0:1788510445.672617:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:1.0:1788510445.672625:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2339:x1875388852628736:12345-192.168.201.4@tcp:8:bash.0 00010000:00080000:1.0:1788510445.672656:0:6670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:1.0:1788510445.672690:0:6670:0:(genops.c:1385:class_connect()) connect: client cef40ebf-ceed-4c16-b27b-e8bced3a8d2f, cookie 0x3e734462ed656b6 00002000:00100000:1.0:1788510445.672702:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cef40ebf-ceed-4c16-b27b-e8bced3a8d2f/ffff929981eae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788510445.672724:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:1.0:1788510445.672960:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788510445.672989:0:6670:0:(import.c:65:import_set_state_nolock()) ffff929981eac800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788510445.673066:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2339:x1875388852628736:12345-192.168.201.4@tcp:8:bash.0 Request processed in 439us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.673075:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 20 00010000:00010000:2.0:1788510445.679988:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed656a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.680038:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed656a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.680048:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed656a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.680055:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510445.680062:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed656a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.680071:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed656a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.680095:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a8b8f5600) 00010000:00010000:2.0:1788510445.680099:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510445.680106:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed656a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.680111:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed656a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510445.681066:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510445.681307:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852628864 00000100:00100000:2.0:1788510445.681319:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852628864 00000100:00100000:2.0:1788510445.681454:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:2.0:1788510445.681465:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:0:x1875388852628864:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510445.681483:0:8183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510445.681509:0:8183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064e29b51/0x3e734462ed656bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73241 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788510445.681572:0:8183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510445.681723:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=303s v=(0 0) 00010000:00010000:2.0:1788510445.681730:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510445.681743:0:8183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064e29b51/0x3e734462ed656bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73241 expref: 7 pid: 8183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.681768:0:8183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000064e29b51/0x3e734462ed656bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73241 expref: 7 pid: 8183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.681784:0:8183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77a00, rc 0) 00000100:00100000:2.0:1788510445.681870:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:0:x1875388852628864:12345-192.168.201.4@tcp:101:bash.0 Request processed in 406us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510445.681878:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00080000:0.0:1788510445.682734:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510445.684729:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510445.684963:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852628992 00000100:00100000:1.0:1788510445.684973:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852628992 00000100:00100000:1.0:1788510445.685036:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:1.0:1788510445.685048:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:10273:x1875388852628992:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:1.0:1788510445.685066:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510445.685100:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73248 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.685131:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064e29b51/0x3e734462ed656bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73241 expref: 8 pid: 8183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.685139:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510445.685143:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510445.685149:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.685192:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064e29b51/0x3e734462ed656bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73241 expref: 8 pid: 8183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.685206:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064e29b51/0x3e734462ed656bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73241 expref: 8 pid: 8183 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510445.685252:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1875388861054848:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510445.685334:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8577b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510445.688865:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510445.691153:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1875388861054848:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510445.691204:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.691261:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033c00, rc 0) 00000100:00100000:1.0:1788510445.691328:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:10273:x1875388852628992:12345-192.168.201.4@tcp:101:bash.0 Request processed in 6282us (6612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.691354:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:2.0:1788510445.693869:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852629120 00000100:00100000:2.0:1788510445.693887:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852629120 00010000:00010000:1.0:1788510445.697665:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064e29b51/0x3e734462ed656bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73241 expref: 8 pid: 8183 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510445.697774:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 35 00000100:00100000:1.0:1788510445.697788:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852629120:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510445.697807:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510445.697842:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064e29b51/0x3e734462ed656bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73241 expref: 8 pid: 8183 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.697856:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064e29b51/0x3e734462ed656bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73241 expref: 8 pid: 8183 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.697887:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064e29b51/0x3e734462ed656bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73241 expref: 8 pid: 8183 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.697908:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510445.697912:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510445.697922:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.697933:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.697993:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510445.698027:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1875388861054976:192.168.201.4@tcp:105: 00000100:00100000:1.0:1788510445.698148:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8577b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788510445.700017:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1875388861054976:192.168.201.4@tcp:105: 00010000:00010000:1.0:1788510445.700045:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510445.700156:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852629120:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 2371us (11300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.700175:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 35 00000100:00100000:0.0:1788510445.702786:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510445.702941:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852629376 00000100:00100000:1.0:1788510445.702970:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852629376 00000100:00100000:1.0:1788510445.703038:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:1.0:1788510445.703049:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:10273:x1875388852629376:12345-192.168.201.4@tcp:35:bash.0 00000100:00100000:1.0:1788510445.703520:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:10273:x1875388852629376:12345-192.168.201.4@tcp:35:bash.0 Request processed in 471us (743us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788510445.703529:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:0.0:1788510445.765562:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861055104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510445.765641:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510445.766997:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861055104 00000100:00100000:2.0:1788510445.767012:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861055104 00000100:00100000:2.0:1788510445.767084:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788510445.767095:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861055104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788510445.767136:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510445.767216:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861055104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510445.767242:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788510445.767334:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861055104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510445.828900:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510445.828960:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852629632 00000100:00100000:2.0:1788510445.828983:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852629632 00000100:00100000:2.0:1788510445.829044:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 41 00000100:00100000:2.0:1788510445.829055:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:10283:x1875388852629632:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510445.829079:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510445.829099:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed656cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7324f expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510445.829186:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788510445.829333:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed656cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7324f expref: 16 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.829350:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:2.0:1788510445.829353:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788510445.829358:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed656cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7324f expref: 16 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.829371:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76a00, rc 0) 00000100:00100000:2.0:1788510445.829427:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:10283:x1875388852629632:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 374us (544us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788510445.829435:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 41 00010000:00010000:2.0:1788510445.832162:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510445.832474:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510445.832608:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852629888 00000100:00100000:3.0:1788510445.832619:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852629888 00000100:00100000:3.0:1788510445.832675:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:3.0:1788510445.832861:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:10283:x1875388852629888:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510445.833314:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:10283:x1875388852629888:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 457us (843us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788510445.833323:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 7 00000001:00100000:0.0:1788510445.851340:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000100:00100000:3.0:1788510445.927485:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510445.928017:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852630016 00000100:00100000:0.0:1788510445.928031:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852630016 00000100:00100000:0.0:1788510445.928169:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 42 00000100:00100000:0.0:1788510445.928181:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:10289:x1875388852630016:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510445.928257:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510445.928282:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed656d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73256 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.928596:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed656e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.928615:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed656e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.928629:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed656e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510445.928673:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788510445.928677:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788510445.928703:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed656e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.928731:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed656d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73256 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.928750:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed656e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73256 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.928760:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:0.0:1788510445.928764:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788510445.928768:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae000, rc 0) 00000100:00100000:0.0:1788510445.928869:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:10289:x1875388852630016:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 690us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510445.928877:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 42 00000100:00100000:3.0:1788510445.933060:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510445.933743:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852630272 00000100:00100000:2.0:1788510445.933754:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852630272 00000100:00100000:2.0:1788510445.933829:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 43 00000100:00100000:2.0:1788510445.933841:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:10289:x1875388852630272:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510445.933937:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510445.933988:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed656e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7325d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.934107:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed656ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.934122:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed656ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.934133:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed656ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510445.934291:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788510445.934777:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed656e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7325d expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.934799:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed656ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7325d expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.934808:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a8b8f5300) 00010000:00010000:2.0:1788510445.934811:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510445.934815:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77400, rc 0) 00000100:00100000:2.0:1788510445.935037:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:10289:x1875388852630272:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 1198us (1991us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788510445.935044:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 43 00000100:00100000:3.0:1788510445.938951:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510445.939050:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510445.939117:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852630656 00000100:00100000:1.0:1788510445.939129:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852630656 00000100:00100000:1.0:1788510445.939218:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 2 00000100:00100000:1.0:1788510445.939253:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:2342:x1875388852630656:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510445.939273:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510445.939306:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed656ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7325d expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.939338:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a8b8f5300) 00010000:00010000:1.0:1788510445.939353:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510445.939709:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852630528 00000100:00100000:0.0:1788510445.939714:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852630528 00000100:00100000:0.0:1788510445.939745:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 44 00000100:00100000:0.0:1788510445.939753:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:10289:x1875388852630528:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510445.939772:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510445.939789:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed656fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73264 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.939968:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65703 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.939982:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65703 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.939993:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65703 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510445.940006:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788510445.940131:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed656fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73264 expref: 22 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.940210:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65703 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73264 expref: 21 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.940219:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a8b8f5300) 00010000:00010000:0.0:1788510445.940240:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788510445.940243:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafc00, rc 0) 00000100:00100000:1.0:1788510445.940347:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:2342:x1875388852630656:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 1096us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.940356:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 2 00000100:00100000:0.0:1788510445.942022:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:10289:x1875388852630528:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 2255us (3154us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788510445.942055:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 44 00000100:00100000:3.0:1788510445.948929:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510445.949474:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852630784 00000100:00100000:1.0:1788510445.949484:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852630784 00000100:00100000:1.0:1788510445.949763:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 23 00000100:00100000:1.0:1788510445.949774:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852630784:12345-192.168.201.4@tcp:1:lfs.0 00010000:00010000:1.0:1788510445.949818:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.949837:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.949846:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510445.949851:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788510445.949920:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.949969:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.949983:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 6 pid: 6670 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510445.949998:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1875388861055232:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510445.950095:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aac6b70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510445.953897:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510445.953968:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852630912 00000100:00100000:3.0:1788510445.953979:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852630912 00002000:00100000:3.0:1788510445.954039:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff929aaed50000 x1875388852630912/t0(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:16/0 lens 504/0 e 0 to 0 dl 1788510456 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788510445.954052:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aaed50000 with x1875388852630912 ext(0->12) 00010000:00010000:3.0:1788510445.954062:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 7 pid: 6670 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.954078:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 7 pid: 6670 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788510445.954085:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff929aaed50000 00000100:00100000:3.0:1788510445.954113:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:3.0:1788510445.954123:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852630912:12345-192.168.201.4@tcp:4:lfs.0 00000100:00100000:3.0:1788510445.956075:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2341:x1875388852630912:12345-192.168.201.4@tcp:4:lfs.0 Request processed in 1945us (2187us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788510445.956087:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 0 00002000:00100000:3.0:1788510445.956098:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff929aaed50000 x1875388852630912/t4294967299(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:16/0 lens 504/448 e 0 to 0 dl 1788510456 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788510445.956108:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aaed50000 with x1875388852630912 ext(0->12) 00010000:00010000:3.0:1788510445.956119:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 9 pid: 6670 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.956137:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 9 pid: 6670 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788510445.956153:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff929aaed50000 00000100:00100000:0.0:1788510445.956275:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1875388861055232:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510445.956299:0:6669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510445.961840:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510445.962044:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852631040 00000100:00100000:1.0:1788510445.962055:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852631040 00010000:00010000:1.0:1788510445.962115:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 9 pid: 6670 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510445.964531:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 36 00000100:00100000:1.0:1788510445.964573:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2340:x1875388852631040:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510445.964802:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788510445.964827:0:5807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788510445.964831:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788510445 00002000:00010000:1.0:1788510445.964834:0:5807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788510445 00002000:00010000:1.0:1788510445.964836:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788510445 00010000:00010000:1.0:1788510445.964846:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 9 pid: 6670 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.964933:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 9 pid: 6670 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.964971:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dca8e4d/0x3e734462ed656c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73248 expref: 9 pid: 6670 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.964994:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788510445.964999:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788510445.965006:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.965019:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.965124:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510445.965212:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852631040:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 666us (3656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.965272:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 36 00010000:00010000:2.0:1788510445.970152:0:6669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.970175:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.970421:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.970431:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.970440:0:6669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.970446:0:6669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510445.970451:0:6669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.970460:0:6669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.970479:0:6669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510445.970486:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091fc710d/0x3e734462ed65711 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510445.970763:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852630784:12345-192.168.201.4@tcp:1:lfs.0 Request processed in 20984us (21904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510445.970774:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 23 00000100:00100000:3.0:1788510445.976061:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510445.976488:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852631296 00000100:00100000:0.0:1788510445.976501:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852631296 00000100:00100000:0.0:1788510445.976560:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:0.0:1788510445.976955:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:10289:x1875388852631296:12345-192.168.201.4@tcp:35:lfs.0 00000004:00010000:0.0:1788510445.977041:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65703 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73264 expref: 20 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788510445.977686:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788510445.977745:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788510445.978524:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788510445.978712:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.978730:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed656a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7323a expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.978740:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.978776:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed656a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7323a expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.978793:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed656a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7323a expref: 24 pid: 5821 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510445.978818:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98430380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1875388861055360:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510445.979254:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c79a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788510445.983824:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510445.984161:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852631424 00000100:00100000:3.0:1788510445.984171:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852631424 00010000:00010000:3.0:1788510445.984218:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed656a8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7323a expref: 25 pid: 5821 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510445.984318:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 37 00000100:00100000:3.0:1788510445.984433:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:2341:x1875388852631424:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510445.984451:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510445.984458:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed656a8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7323a expref: 25 pid: 5821 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.984471:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed656a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7323a expref: 25 pid: 5821 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.984493:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a8b8f5300) 00010000:00010000:3.0:1788510445.984499:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.984508:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.984516:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510445.984535:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510445.984698:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:2341:x1875388852631424:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 370us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510445.984706:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 37 00010000:00010000:0.0:1788510445.985251:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed656a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7323a expref: 24 pid: 5821 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510445.985273:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98430380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1875388861055360:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510445.985292:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.985300:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.985307:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788510445.985479:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788510445.985748:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788510445.985918:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98430380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1875388861055488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788510445.985978:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510445.986063:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c79e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788510445.987528:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861055488 00000100:00100000:3.0:1788510445.987541:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861055488 00000100:00100000:3.0:1788510445.987759:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788510445.987771:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875388861055488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788510445.987936:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875388861055488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 167us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510445.987953:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510445.988101:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98430380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1875388861055488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788510445.989029:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788510445.989108:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98430380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1875388861055616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788510445.989154:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510445.989266:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c79a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510445.989340:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861055616 00000100:00100000:3.0:1788510445.989345:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861055616 00000100:00100000:3.0:1788510445.989377:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788510445.989385:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875388861055616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788510445.989549:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1875388861055616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 164us (393us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788510445.989566:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788510445.989794:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98430380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1875388861055616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788510445.989851:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788510445.989900:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.989910:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.989918:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.989925:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510445.989930:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.989937:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.989963:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a8b8f5300) 00010000:00010000:0.0:1788510445.989966:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788510445.989971:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510445.989976:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65718 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788510445.990127:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788510445.990382:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788510445.990395:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303809170803ns, next at 304809168797ns, rc = 0 00000001:00080000:0.0:1788510445.990403:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788510445.990438:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a8b8f5300) 00010000:00010000:0.0:1788510445.990441:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788510445.990456:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65703 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73264 expref: 28 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510445.990571:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10289:x1875388852631296:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 14001us (14519us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788510445.990589:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 8 00000020:00080000:0.0:1788510445.990594:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788510445.994844:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510445.995121:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852631552 00000100:00100000:1.0:1788510445.995131:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852631552 00000100:00100000:1.0:1788510445.995202:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 45 00000100:00100000:1.0:1788510445.995214:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10289:x1875388852631552:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510445.995481:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510445.995506:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6571f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7326b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.995703:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6571f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7326b expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.995719:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6571f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7326b expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510445.995739:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:1.0:1788510445.995743:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788510445.995747:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033c00, rc 0) 00000100:00100000:1.0:1788510445.995810:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:10289:x1875388852631552:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 598us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510445.995818:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 45 00000100:00100000:2.0:1788510446.000204:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510446.000432:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852631808 00000100:00100000:3.0:1788510446.000444:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852631808 00000100:00100000:3.0:1788510446.000503:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:3.0:1788510446.000515:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:10289:x1875388852631808:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510446.001022:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+29:10289:x1875388852631808:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 507us (826us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788510446.001032:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:2.0:1788510446.104493:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510446.104623:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852632064 00000100:00100000:0.0:1788510446.104634:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852632064 00000100:00100000:0.0:1788510446.104735:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 46 00000100:00100000:0.0:1788510446.104747:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+29:10299:x1875388852632064:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510446.104772:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510446.104795:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65726 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73272 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510446.104897:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788510446.105062:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65726 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73272 expref: 31 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.105077:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:0.0:1788510446.105080:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788510446.105085:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73272 expref: 31 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.105099:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafc00, rc 0) 00000100:00100000:0.0:1788510446.105568:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:10299:x1875388852632064:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 821us (1085us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788510446.105576:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 46 00000100:00100000:2.0:1788510446.111759:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510446.111892:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852632192 00000100:00100000:1.0:1788510446.111908:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852632192 00000100:00100000:1.0:1788510446.112012:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 47 00000100:00100000:1.0:1788510446.112023:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:10299:x1875388852632192:12345-192.168.201.4@tcp:34:lfs.0 00010000:00010000:1.0:1788510446.112138:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed65734 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112161:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed65734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112186:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed65734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112207:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6573b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112214:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6573b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112244:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6573b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112524:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112534:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112541:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788510446.112592:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112605:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed65734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112618:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed65734 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112624:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed65734 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112630:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510446.112635:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed65734 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112644:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed65734 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112656:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:1.0:1788510446.112659:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510446.112665:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed65734 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112671:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed65734 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112684:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6573b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112690:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6573b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112696:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6573b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112700:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510446.112709:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6573b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112716:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6573b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112724:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a82b92600) 00010000:00010000:1.0:1788510446.112726:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510446.112728:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6573b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112734:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6573b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112750:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112756:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65742 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112762:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112767:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510446.112770:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112776:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112783:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:1.0:1788510446.112785:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510446.112795:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65742 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.112801:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510446.113015:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:10299:x1875388852632192:12345-192.168.201.4@tcp:34:lfs.0 Request processed in 992us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510446.113024:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 47 00000100:00100000:2.0:1788510446.119003:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510446.119097:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852632448 00000100:00100000:0.0:1788510446.119108:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852632448 00000100:00100000:0.0:1788510446.119685:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:0.0:1788510446.119699:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:10299:x1875388852632448:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:0.0:1788510446.120077:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:10299:x1875388852632448:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 381us (1083us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788510446.120085:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:2.0:1788510446.177318:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510446.177811:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852632704 00000100:00100000:0.0:1788510446.177827:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852632704 00000100:00100000:0.0:1788510446.177917:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 48 00000100:00100000:0.0:1788510446.177930:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:10302:x1875388852632704:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510446.177970:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510446.178000:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65749 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73279 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.178122:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65750 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.178154:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.178169:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.178416:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed65757 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.178427:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed65757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.178460:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed65757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.178810:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6575e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.178820:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6575e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.178827:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6575e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510446.178840:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788510446.179029:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179038:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65750 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179044:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65750 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179050:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510446.179054:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65750 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179061:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65750 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179072:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:0.0:1788510446.179075:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510446.179088:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65750 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179095:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65750 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179109:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed65757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179116:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed65757 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179124:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed65757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179129:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaec00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510446.179131:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed65757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179137:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed65757 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179151:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a8b8f5300) 00010000:00010000:0.0:1788510446.179154:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510446.179156:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed65757 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179161:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed65757 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179750:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65749 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73279 expref: 34 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179784:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6575e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73279 expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.179792:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:0.0:1788510446.179794:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510446.179797:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafa00, rc 0) 00000100:00100000:0.0:1788510446.179992:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+33:10302:x1875388852632704:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 2063us (2688us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788510446.180001:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 48 00000100:00100000:3.0:1788510446.186422:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510446.186619:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852632832 00000100:00100000:1.0:1788510446.186629:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852632832 00000100:00100000:1.0:1788510446.186690:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00100000:1.0:1788510446.186701:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+33:10302:x1875388852632832:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:1.0:1788510446.186775:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6576c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.186796:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6576c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.186809:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6576c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.186838:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6576c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.186845:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6576c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.186972:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6576c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.186979:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510446.186994:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6576c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.187003:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6576c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.187015:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:1.0:1788510446.187018:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788510446.187023:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6576c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.187030:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6576c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510446.187118:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+33:10302:x1875388852632832:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 418us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510446.187126:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00100000:2.0:1788510446.192155:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510446.192503:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852633088 00000100:00100000:3.0:1788510446.192514:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852633088 00000100:00100000:3.0:1788510446.192616:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:3.0:1788510446.192628:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+33:10302:x1875388852633088:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:2.0:1788510446.194827:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+34:10302:x1875388852633088:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 2187us (2682us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788510446.194861:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:2.0:1788510446.458157:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510446.458363:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852633344 00000100:00100000:3.0:1788510446.458375:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852633344 00000100:00100000:3.0:1788510446.458444:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 50 00000100:00100000:3.0:1788510446.458456:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+34:10333:x1875388852633344:12345-192.168.201.4@tcp:101:cat.0 00010000:00010000:3.0:1788510446.458482:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510446.458505:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed65773 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73280 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.458624:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed6577a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.458640:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed6577a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.458654:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed6577a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510446.458667:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788510446.458809:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed65773 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73280 expref: 37 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.458827:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed6577a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73280 expref: 36 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.458837:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:3.0:1788510446.458839:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510446.458843:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69200, rc 0) 00000100:00100000:3.0:1788510446.459069:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:10333:x1875388852633344:12345-192.168.201.4@tcp:101:cat.0 Request processed in 614us (934us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788510446.459078:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 50 00000100:00100000:2.0:1788510446.465108:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510446.465486:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510446.466023:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852633728 00000100:00100000:0.0:1788510446.466035:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852633728 00000100:00100000:0.0:1788510446.466099:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:0.0:1788510446.466109:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:10333:x1875388852633728:12345-192.168.201.4@tcp:35:cat.0 00000100:00100000:0.0:1788510446.466827:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+37:10333:x1875388852633728:12345-192.168.201.4@tcp:35:cat.0 Request processed in 716us (1339us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788510446.466837:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:1.0:1788510446.466973:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852633472 00000100:00100000:1.0:1788510446.466979:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852633472 00000100:00100000:1.0:1788510446.467067:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 3 00000100:00100000:1.0:1788510446.467077:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+37:2342:x1875388852633472:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510446.467089:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510446.467111:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed6577a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73280 expref: 37 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.467130:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:1.0:1788510446.467135:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510446.467184:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:2342:x1875388852633472:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 109us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510446.467458:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 3 00000100:00100000:1.0:1788510446.538365:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510446.538736:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852633984 00000100:00100000:3.0:1788510446.538746:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852633984 00000100:00100000:3.0:1788510446.538806:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 51 00000100:00100000:3.0:1788510446.538816:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:10339:x1875388852633984:12345-192.168.201.4@tcp:101:dd.0 00010000:00010000:3.0:1788510446.538839:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510446.538842:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788510446.538867:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed656e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73256 expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.538887:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:3.0:1788510446.538892:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788510446.538904:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed65788 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73287 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.539004:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.539018:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6575e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73279 expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.539025:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.539054:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6575e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73279 expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.539084:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6575e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73279 expref: 36 pid: 5821 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510446.539099:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861055744:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510446.539764:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788510446.543321:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510446.543542:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861055744:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510446.543582:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510446.543801:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852634112 00000100:00100000:2.0:1788510446.543809:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852634112 00010000:00010000:2.0:1788510446.543847:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6575e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73279 expref: 37 pid: 5821 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510446.543876:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 38 00000100:00100000:2.0:1788510446.543885:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+37:2340:x1875388852634112:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510446.543900:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510446.543907:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6575e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73279 expref: 37 pid: 5821 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510446.543918:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6575e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73279 expref: 37 pid: 5821 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510446.543976:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6575e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73279 expref: 37 pid: 5821 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510446.543991:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:2.0:1788510446.543997:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510446.544006:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510446.544013:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510446.544044:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510446.544100:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:2340:x1875388852634112:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 214us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510446.544107:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 38 00010000:00010000:1.0:1788510446.544697:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.544707:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510446.544731:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788510446.544941:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed65788 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73287 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.544959:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73287 expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.544968:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:1.0:1788510446.544970:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788510446.544974:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69e00, rc 0) 00000100:00100000:1.0:1788510446.545025:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:10339:x1875388852633984:12345-192.168.201.4@tcp:101:dd.0 Request processed in 6211us (6672us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788510446.545034:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 51 00000100:00100000:3.0:1788510446.551205:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510446.551321:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852634368 00000100:00100000:0.0:1788510446.551332:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852634368 00000100:00100000:0.0:1788510446.551393:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 52 00000100:00100000:0.0:1788510446.551404:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:10339:x1875388852634368:12345-192.168.201.4@tcp:36:dd.0 00010000:00010000:0.0:1788510446.551695:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed6579d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.551714:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed6579d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.551742:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed6579d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788510446.551792:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788510446.551818:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b048b58 reply state 0000000027f1ea96 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed6579d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510446.551826:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788510446.551914:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+39:10339:x1875388852634368:12345-192.168.201.4@tcp:36:dd.0 Request processed in 511us (718us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788510446.551921:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 52 00000020:00080000:0.0:1788510446.551926:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788510446.559796:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed6579d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.559820:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed6579d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.559829:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed6579d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.559836:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafc00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510446.559842:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed6579d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.559850:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed6579d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.559871:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:0.0:1788510446.559874:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510446.559900:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed6579d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.559907:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed6579d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.853512:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510446.879010:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510446.879155:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852634496 00000100:00100000:1.0:1788510446.879165:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852634496 00000100:00100000:1.0:1788510446.879256:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 53 00000100:00100000:1.0:1788510446.879285:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+38:10353:x1875388852634496:12345-192.168.201.4@tcp:101:stat.0 00010000:00010000:1.0:1788510446.879315:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510446.879336:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed657a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7328e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.879400:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed657ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.879418:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed657ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.879431:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed657ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.879447:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed657b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.879455:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed657b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.879462:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed657b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.890100:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.890130:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73287 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.890139:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.890191:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73287 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.890207:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73287 expref: 39 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510446.890250:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861055872:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510446.890346:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa1f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510446.893441:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861055872:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510446.893559:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510446.895307:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510446.896125:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852634752 00000100:00100000:3.0:1788510446.896140:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852634752 00000100:00100000:3.0:1788510446.896212:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:3.0:1788510446.896257:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+40:5581:x1875388852634752:12345-192.168.201.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788510446.898441:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+41:5581:x1875388852634752:12345-192.168.201.4@tcp:35:ldlm_bl.0 Request processed in 2208us (3131us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788510446.898453:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:2.0:1788510446.906122:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510446.906256:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852634880 00000100:00100000:1.0:1788510446.906269:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852634880 00010000:00010000:1.0:1788510446.906317:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73287 expref: 41 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510446.906360:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 39 00000100:00100000:1.0:1788510446.906372:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+41:2340:x1875388852634880:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510446.906390:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510446.906397:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73287 expref: 41 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.906411:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73287 expref: 41 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.906434:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6578f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73287 expref: 41 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.906453:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:1.0:1788510446.906466:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.906478:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.906486:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510446.906524:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510446.906552:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906560:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510446.906570:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+40:2340:x1875388852634880:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 201us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510446.906578:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 39 00000004:00200000:0.0:1788510446.906614:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788510446.906619:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788510446.906671:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906688:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906698:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed657ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906706:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed657ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906713:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed657ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906719:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510446.906725:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed657ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906742:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed657ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906754:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:0.0:1788510446.906757:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510446.906762:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed657ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906768:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed657ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906782:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed657b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906789:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed657b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906795:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed657b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906799:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510446.906802:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed657b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906807:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed657b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906814:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a82b92600) 00010000:00010000:0.0:1788510446.906817:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510446.906819:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed657b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.906834:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed657b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788510446.906852:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:3.0:1788510446.906871:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788510446.906889:0:5843:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff929a88c79e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788510446.906893:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929a83005d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff929a88c79000 00000020:00080000:3.0:1788510446.906896:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929a83005300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff929ab506dc00 00010000:00010000:0.0:1788510446.907004:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed657a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7328e expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.907021:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7328e expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.907029:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:0.0:1788510446.907031:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510446.907034:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032600, rc 0) 00000020:00080000:3.0:1788510446.907043:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1788510446.907060:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:10353:x1875388852634496:12345-192.168.201.4@tcp:101:stat.0 Request processed in 27779us (28066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510446.907067:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 53 00000020:00080000:3.0:1788510446.907133:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788510446.907153:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861056000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788510446.907208:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510446.907329:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861056000 00000100:00100000:0.0:1788510446.907335:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861056000 00000100:00100000:0.0:1788510446.907364:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788510446.907372:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3288:x1875388861056000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788510446.907397:0:6667:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788510446.907428:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9a80ed, atime: 0x6a9a80ed, ctime: 0x6a9a80ed, blocks: 0x1 00010000:00010000:0.0:1788510446.907434:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c8e4ed8/0x3e734462ed657c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.907449:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=304s v=(0 0) 00010000:00010000:0.0:1788510446.907454:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510446.907466:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c8e4ed8/0x3e734462ed657c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.907481:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c8e4ed8/0x3e734462ed657c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.907489:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c8e4ed8/0x3e734462ed657c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.907497:0:6667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c8e4ed8/0x3e734462ed657c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.907519:0:6667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788510446.907827:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510446.907835:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c8e4ed8/0x3e734462ed657c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.907843:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafc00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510446.907847:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c8e4ed8/0x3e734462ed657c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.907855:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c8e4ed8/0x3e734462ed657c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.907869:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c8e4ed8/0x3e734462ed657c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.907876:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c8e4ed8/0x3e734462ed657c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510446.908160:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510446.908163:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510446.908165:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788510446.909909:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929aaed50380/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788510446.909936:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861056000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788510446.911352:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3288:x1875388861056000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1166us (1329us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788510446.911368:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788510446.998454:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510446.998594:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852635136 00000100:00100000:0.0:1788510446.998607:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852635136 00000100:00100000:0.0:1788510446.998681:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 54 00000100:00100000:0.0:1788510446.998693:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+12:10359:x1875388852635136:12345-192.168.201.4@tcp:36:truncate.0 00010000:00010000:0.0:1788510446.998756:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510446.998792:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed657b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7328e expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.998816:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:0.0:1788510446.998822:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510446.999071:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed657c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.999103:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed657c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510446.999116:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed657c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788510446.999173:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788510446.999197:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000758ec1e9 reply state 00000000a9d78b49 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed657c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510446.999206:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788510446.999406:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:10359:x1875388852635136:12345-192.168.201.4@tcp:36:truncate.0 Request processed in 714us (962us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788510446.999413:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 54 00000020:00080000:0.0:1788510446.999418:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788510447.001319:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed657c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.001340:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed657c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.001349:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed657c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.001357:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaec00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510447.001363:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed657c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.001373:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed657c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.001393:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:1.0:1788510447.001396:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510447.001402:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed657c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.001419:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed657c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510447.160894:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510447.161177:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852635264 00000100:00100000:1.0:1788510447.161278:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852635264 00000100:00100000:1.0:1788510447.161410:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 55 00000100:00100000:1.0:1788510447.161421:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:10373:x1875388852635264:12345-192.168.201.4@tcp:101:stat.0 00010000:00010000:1.0:1788510447.161445:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510447.161471:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed657ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73295 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.161550:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed657d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.161705:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed657d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.161716:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed657d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.161728:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed657dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.161732:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed657dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.161736:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed657dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788510447.162013:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788510447.162401:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162417:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162425:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510447.162458:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788510447.162463:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510447.162483:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162494:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162501:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed657d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162507:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed657d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162513:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed657d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162518:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510447.162522:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed657d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162529:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed657d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162540:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:1.0:1788510447.162543:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510447.162554:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed657d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162932:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed657d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162946:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed657dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162950:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed657dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162954:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed657dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162957:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510447.162959:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed657dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162962:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed657dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162968:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a82b92f00) 00010000:00010000:1.0:1788510447.162969:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510447.162972:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed657dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.162975:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed657dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.163004:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed657ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73295 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.163022:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73295 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.163027:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:1.0:1788510447.163028:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788510447.163030:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033400, rc 0) 00000100:00100000:1.0:1788510447.163103:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:10373:x1875388852635264:12345-192.168.201.4@tcp:101:stat.0 Request processed in 1683us (2218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510447.163112:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 55 00000100:00100000:3.0:1788510447.278698:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510447.279765:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852635520 00000100:00100000:0.0:1788510447.279783:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852635520 00000100:00100000:0.0:1788510447.279854:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 56 00000100:00100000:0.0:1788510447.279864:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:10383:x1875388852635520:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510447.279886:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510447.279907:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed657ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7329c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510447.280030:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788510447.280152:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed657ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7329c expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.280167:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:0.0:1788510447.280182:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788510447.280332:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed657ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7329c expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.280347:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae200, rc 0) 00000100:00100000:0.0:1788510447.280423:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:10383:x1875388852635520:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 560us (1734us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788510447.280430:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 56 00000100:00100000:2.0:1788510447.283351:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510447.283599:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852635776 00000100:00100000:0.0:1788510447.283609:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852635776 00000100:00100000:0.0:1788510447.283681:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:0.0:1788510447.283693:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:10383:x1875388852635776:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:0.0:1788510447.283988:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:10383:x1875388852635776:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 296us (646us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788510447.283995:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:3.0:1788510447.361978:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510447.362318:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852636032 00000100:00100000:0.0:1788510447.362328:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852636032 00000100:00100000:0.0:1788510447.362385:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 57 00000100:00100000:0.0:1788510447.362392:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:10389:x1875388852636032:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:0.0:1788510447.362413:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510447.362430:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed657f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.362516:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.362528:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73295 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.362551:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.362589:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73295 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.362605:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73295 expref: 17 pid: 5823 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510447.362618:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98430000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861056128:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510447.362733:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c796c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510447.365836:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98430000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861056128:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510447.365881:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510447.367340:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510447.367583:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852636160 00000100:00100000:0.0:1788510447.367594:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852636160 00010000:00010000:0.0:1788510447.367640:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73295 expref: 18 pid: 5823 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510447.367687:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 40 00000100:00100000:0.0:1788510447.367698:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:2340:x1875388852636160:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510447.367717:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510447.367724:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73295 expref: 18 pid: 5823 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.367760:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73295 expref: 18 pid: 5823 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.367791:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed657e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73295 expref: 18 pid: 5823 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.367811:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:0.0:1788510447.367817:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.367828:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.367837:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.367866:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510447.367936:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:2340:x1875388852636160:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 239us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510447.367945:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 40 00010000:00010000:3.0:1788510447.368212:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.368260:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510447.368279:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788510447.368431:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed657f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732a3 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.368446:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732a3 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.368453:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:3.0:1788510447.368457:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788510447.368459:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf600, rc 0) 00000100:00100000:3.0:1788510447.368502:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:10389:x1875388852636032:12345-192.168.201.4@tcp:101:bash.0 Request processed in 6109us (6536us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788510447.368509:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 57 00000100:00100000:3.0:1788510447.372568:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510447.372693:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852636416 00000100:00100000:0.0:1788510447.372710:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852636416 00000100:00100000:0.0:1788510447.372804:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 58 00000100:00100000:0.0:1788510447.372816:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:10389:x1875388852636416:12345-192.168.201.4@tcp:36:bash.0 00010000:00010000:0.0:1788510447.373121:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6580d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.373139:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6580d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.373171:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6580d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788510447.373263:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788510447.373290:0:9544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ba64d28 reply state 000000007ed88995 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6580d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510447.373299:0:9544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788510447.373491:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:10389:x1875388852636416:12345-192.168.201.4@tcp:36:bash.0 Request processed in 676us (938us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788510447.373497:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 58 00000020:00080000:0.0:1788510447.373502:0:9544:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788510447.377013:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00010000:00010000:0.0:1788510447.377016:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6580d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.377030:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6580d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.377038:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6580d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.377045:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaec00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510447.377050:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6580d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.377058:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6580d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.377093:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:0.0:1788510447.377097:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788510447.377108:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852636544 00010000:00010000:0.0:1788510447.377118:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6580d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510447.377120:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852636544 00010000:00010000:0.0:1788510447.377125:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6580d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510447.377175:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 59 00000100:00100000:1.0:1788510447.377185:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:10389:x1875388852636544:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:1.0:1788510447.377207:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510447.377247:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732aa expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.377339:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6581b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.377358:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732a3 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.377367:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6581b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.377412:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732a3 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510447.377432:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732a3 expref: 20 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510447.377446:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861056256:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510447.377539:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa1f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788510447.379585:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510447.379647:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852636672 00000100:00100000:2.0:1788510447.379656:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852636672 00000100:00100000:3.0:1788510447.379680:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861056256:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510447.379689:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732a3 expref: 21 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.379702:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6581b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510447.379738:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 41 00000100:00100000:2.0:1788510447.379748:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:2340:x1875388852636672:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510447.379762:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510447.379769:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732a3 expref: 21 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.379781:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732a3 expref: 21 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.379802:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed657ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732a3 expref: 21 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.379817:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:2.0:1788510447.379822:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6581b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.379830:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6581b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.379838:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6581b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.379859:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510447.379952:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:2340:x1875388852636672:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 205us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510447.379960:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 41 00010000:00010000:3.0:1788510447.379967:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6581b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.379973:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6581b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510447.380016:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788510447.380027:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510447.380045:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6581b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.380071:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732aa expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.380083:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6581b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732aa expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.380090:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:3.0:1788510447.380093:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510447.380095:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032000, rc 0) 00000100:00100000:3.0:1788510447.380119:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:10389:x1875388852636544:12345-192.168.201.4@tcp:101:bash.0 Request processed in 2937us (3120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510447.380126:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 59 00000100:00100000:2.0:1788510447.383444:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510447.383542:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852636928 00000100:00100000:0.0:1788510447.383552:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852636928 00000100:00100000:0.0:1788510447.383611:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:0.0:1788510447.383621:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:10389:x1875388852636928:12345-192.168.201.4@tcp:35:bash.0 00000100:00100000:0.0:1788510447.383846:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:10389:x1875388852636928:12345-192.168.201.4@tcp:35:bash.0 Request processed in 226us (412us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788510447.383858:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:0.0:1788510447.477499:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510447.477596:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852637184 00000100:00100000:3.0:1788510447.477606:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852637184 00000100:00100000:3.0:1788510447.477682:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 60 00000100:00100000:3.0:1788510447.477693:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:10399:x1875388852637184:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:3.0:1788510447.477717:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510447.477738:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732b1 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510447.477839:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788510447.477980:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65822 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732b1 expref: 22 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.477999:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:3.0:1788510447.478020:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788510447.478027:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732b1 expref: 22 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.478044:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69800, rc 0) 00000100:00100000:3.0:1788510447.478454:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10399:x1875388852637184:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 761us (964us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788510447.478463:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 60 00000100:00100000:1.0:1788510447.482761:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510447.482862:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852637312 00000100:00100000:3.0:1788510447.482875:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852637312 00000100:00100000:3.0:1788510447.482994:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 61 00000100:00100000:3.0:1788510447.483004:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10399:x1875388852637312:12345-192.168.201.4@tcp:34:lfs.0 00010000:00010000:3.0:1788510447.483113:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65830 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483131:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483158:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483174:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed65837 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483181:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed65837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483189:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed65837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483806:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed6583e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483823:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed6583e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483831:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed6583e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788510447.483893:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed6583e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483909:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483928:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65830 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483936:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483943:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510447.483948:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483957:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65830 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483970:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:3.0:1788510447.483973:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510447.483977:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.483984:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65830 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484009:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed65837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484015:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed65837 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484022:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed65837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484027:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510447.484030:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed65837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484036:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed65837 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484045:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a83eab200) 00010000:00010000:3.0:1788510447.484047:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510447.484051:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed65837 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484057:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed65837 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484072:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed6583e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484077:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed6583e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484083:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed6583e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484093:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510447.484097:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed6583e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484102:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed6583e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484110:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:3.0:1788510447.484112:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510447.484115:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed6583e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.484120:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed6583e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510447.484389:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10399:x1875388852637312:12345-192.168.201.4@tcp:34:lfs.0 Request processed in 1383us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510447.484399:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 61 00000100:00100000:1.0:1788510447.487520:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510447.487703:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852637568 00000100:00100000:0.0:1788510447.487715:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852637568 00000100:00100000:0.0:1788510447.487780:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:0.0:1788510447.487791:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10399:x1875388852637568:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:0.0:1788510447.488048:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:10399:x1875388852637568:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 257us (539us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788510447.488055:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:0.0:1788510447.528338:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510447.528471:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852637824 00000100:00100000:2.0:1788510447.528481:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852637824 00000100:00100000:2.0:1788510447.528559:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 62 00000100:00100000:2.0:1788510447.528571:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:10402:x1875388852637824:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510447.528601:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510447.528627:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65845 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.528727:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed6584c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.528744:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed6584c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.528755:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed6584c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.528784:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.528792:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.528798:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529158:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed6585a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529168:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed6585a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529187:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed6585a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510447.529198:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788510447.529327:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed6584c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529335:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed6584c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529340:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed6584c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529346:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510447.529350:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed6584c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529357:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed6584c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529369:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:2.0:1788510447.529371:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510447.529376:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed6584c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529381:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed6584c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529394:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529399:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529410:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529415:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510447.529418:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529424:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65853 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529430:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929aac578800) 00010000:00010000:2.0:1788510447.529433:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510447.529436:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65853 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529442:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529487:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65845 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732b8 expref: 25 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529502:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed6585a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732b8 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.529509:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:2.0:1788510447.529511:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510447.529514:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77a00, rc 0) 00000100:00100000:2.0:1788510447.529579:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:10402:x1875388852637824:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 1009us (1253us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788510447.529595:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 62 00000100:00100000:1.0:1788510447.534161:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510447.534210:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510447.534382:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852637952 00000100:00100000:3.0:1788510447.534391:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852637952 00000100:00100000:3.0:1788510447.534450:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 63 00000100:00100000:3.0:1788510447.534461:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:10402:x1875388852637952:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:3.0:1788510447.534544:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.534569:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.534581:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.534623:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.534631:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65868 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.534639:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.534644:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510447.534649:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.534657:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65868 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.534668:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:3.0:1788510447.534671:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788510447.534676:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65868 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.534683:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510447.534755:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:10402:x1875388852637952:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 295us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510447.534763:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 63 00000100:00100000:0.0:1788510447.535860:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852638080 00000100:00100000:0.0:1788510447.535869:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852638080 00000100:00100000:0.0:1788510447.535932:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:0.0:1788510447.535943:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:2340:x1875388852638080:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510447.535955:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510447.535983:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed6585a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732b8 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.535999:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:0.0:1788510447.536004:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510447.536130:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:2340:x1875388852638080:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 189us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510447.536137:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:2.0:1788510447.538942:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510447.539001:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852638336 00000100:00100000:0.0:1788510447.539010:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852638336 00000100:00100000:0.0:1788510447.539059:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:0.0:1788510447.539068:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:10402:x1875388852638336:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:0.0:1788510447.539328:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:10402:x1875388852638336:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 260us (423us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788510447.539335:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:2.0:1788510447.645974:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510447.646076:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852638592 00000100:00100000:0.0:1788510447.646086:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852638592 00000100:00100000:0.0:1788510447.646159:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 64 00000100:00100000:0.0:1788510447.646169:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:10420:x1875388852638592:12345-192.168.201.4@tcp:101:cat.0 00010000:00010000:0.0:1788510447.646193:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510447.646217:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6586f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732bf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.646412:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65876 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.646428:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65876 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.646447:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65876 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510447.646460:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788510447.646626:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed6586f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732bf expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.646646:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65876 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732bf expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510447.646655:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:0.0:1788510447.646658:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788510447.646661:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae000, rc 0) 00000100:00100000:0.0:1788510447.646737:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:10420:x1875388852638592:12345-192.168.201.4@tcp:101:cat.0 Request processed in 570us (774us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788510447.646744:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 64 00000100:00100000:1.0:1788510447.668818:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510447.668944:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852638720 00000100:00100000:3.0:1788510447.668954:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852638720 00000100:00100000:3.0:1788510447.669009:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 65 00000100:00100000:3.0:1788510447.669038:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:10421:x1875388852638720:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:3.0:1788510447.669059:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510447.669077:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732c6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.669129:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6588b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.669139:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6588b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.669147:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6588b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510447.669174:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788510447.669176:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510447.669191:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6588b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.669217:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732c6 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.669265:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6588b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732c6 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.669273:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:3.0:1788510447.669276:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788510447.669280:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68200, rc 0) 00000100:00100000:3.0:1788510447.669349:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10421:x1875388852638720:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 313us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510447.669366:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 65 00000100:00100000:2.0:1788510447.676970:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510447.677198:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852639104 00000100:00100000:0.0:1788510447.677208:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852639104 00000100:00100000:0.0:1788510447.677296:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:0.0:1788510447.677306:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10421:x1875388852639104:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:0.0:1788510447.677844:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:10421:x1875388852639104:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 536us (888us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788510447.677852:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:2.0:1788510447.680606:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510447.680777:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852639232 00000100:00100000:3.0:1788510447.680788:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852639232 00000100:00100000:3.0:1788510447.680850:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 5 00000100:00100000:3.0:1788510447.680861:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:10421:x1875388852639232:12345-192.168.201.4@tcp:103:lfs.0 00010000:00010000:3.0:1788510447.680877:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788510447.680903:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6581b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732aa expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.680941:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732bf expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.680954:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6571f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7326b expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.680964:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a82b92c00) 00010000:00010000:3.0:1788510447.680975:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510447.681042:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:10421:x1875388852639232:12345-192.168.201.4@tcp:103:lfs.0 Request processed in 183us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510447.681049:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 5 00000100:00100000:0.0:1788510447.684398:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510447.684658:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852639360 00000100:00100000:2.0:1788510447.684667:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852639360 00000100:00100000:2.0:1788510447.684880:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 66 00000100:00100000:2.0:1788510447.684893:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:10421:x1875388852639360:12345-192.168.201.4@tcp:58:lfs.0 00010000:00010000:2.0:1788510447.685020:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65892 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.685040:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65892 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510447.685054:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65892 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788510447.685946:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788510447.686143:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788510447.686209:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788510447.686358:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:10421:x1875388852639360:12345-192.168.201.4@tcp:58:lfs.0 Request processed in 1464us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510447.686368:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 66 00000100:00100000:2.0:1788510447.715282:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510447.715569:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852639488 00000100:00100000:3.0:1788510447.715581:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852639488 00000100:00100000:3.0:1788510447.715658:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 67 00000100:00100000:3.0:1788510447.715669:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:10423:x1875388852639488:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:3.0:1788510447.715698:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510447.715724:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65899 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732cd expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.715836:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed658a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.715854:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed658a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.715868:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed658a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.715889:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed658a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.715896:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed658a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.715903:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed658a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716154:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716164:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716605:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510447.716652:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788510447.716657:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510447.716679:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716707:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716717:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed658a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716724:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed658a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716732:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed658a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716738:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510447.716743:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed658a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716751:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed658a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716766:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:3.0:1788510447.716769:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510447.716774:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed658a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716781:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed658a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716795:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed658a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716802:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed658a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716819:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed658a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716824:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510447.716827:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed658a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716833:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed658a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716841:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a83eab200) 00010000:00010000:3.0:1788510447.716843:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510447.716846:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed658a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716852:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed658a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716886:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65899 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732cd expref: 27 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716901:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732cd expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510447.716907:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578800) 00010000:00010000:3.0:1788510447.717284:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788510447.717288:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68e00, rc 0) 00000100:00100000:3.0:1788510447.717439:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:10423:x1875388852639488:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 1769us (2220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510447.717458:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 67 00010000:00010000:0.0:1788510447.876759:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510448.325372:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788510448.325398:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb2f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861056384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788510448.325482:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510448.325588:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861056384 00000100:00100000:2.0:1788510448.325595:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861056384 00000100:00100000:2.0:1788510448.325662:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788510448.325674:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875388861056384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510448.325716:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510448.325766:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875388861056384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510448.325773:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788510448.325793:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510448.325832:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb2f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861056384:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788510448.518763:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788510448.518780:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788510448.518835:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788510448.518841:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788510448.518973:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a87e3e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861056512:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788510448.519678:0:11661:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aa06ecf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510448.523795:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510448.523835:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852639616 00000100:00100000:2.0:1788510448.523844:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852639616 00000100:00100000:2.0:1788510448.523913:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 1 00000100:00100000:2.0:1788510448.523925:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10434:x1875388852639616:12345-192.168.201.4@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788510448.524019:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10434:x1875388852639616:12345-192.168.201.4@tcp:900:lhsmtool_posix.0 Request processed in 96us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510448.524026:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 1 00000100:00100000:0.0:1788510448.525417:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a87e3e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861056512:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788510448.531400:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510448.531487:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852639744 00000100:00100000:1.0:1788510448.531497:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852639744 00000100:00100000:1.0:1788510448.531560:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 68 00000100:00100000:1.0:1788510448.531570:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:10434:x1875388852639744:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788510448.531598:0:9544:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788510448.531725:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:10434:x1875388852639744:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 155us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510448.531733:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 68 00000100:00100000:0.0:1788510448.543340:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510448.543802:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852639872 00000100:00100000:1.0:1788510448.543811:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852639872 00000100:00100000:1.0:1788510448.543863:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 69 00000100:00100000:1.0:1788510448.543872:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:10434:x1875388852639872:12345-192.168.201.4@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788510448.543963:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed658b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.543988:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed658b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544001:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed658b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544016:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed658bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544023:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed658bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544041:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed658bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544072:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed658c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544079:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed658c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544083:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed658c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510448.544112:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788510448.544115:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510448.544125:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed658c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544133:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed658b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544153:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed658b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544158:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed658b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544162:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510448.544166:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed658b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544174:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed658b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544184:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:1.0:1788510448.544187:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510448.544192:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed658b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544199:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed658b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544210:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed658bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544216:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed658bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544242:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed658bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544245:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510448.544252:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed658bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544257:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed658bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544262:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff929a82b92f00) 00010000:00010000:1.0:1788510448.544264:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510448.544266:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed658bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544270:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed658bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544281:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed658c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544284:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed658c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544287:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed658c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544290:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510448.544292:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed658c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544295:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed658c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544298:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578800) 00010000:00010000:1.0:1788510448.544300:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510448.544305:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed658c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.544309:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed658c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510448.544379:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:10434:x1875388852639872:12345-192.168.201.4@tcp:34:lhsmtool_posix.0 Request processed in 508us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510448.544384:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 69 00000100:00100000:1.0:1788510448.548673:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510448.548736:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852640128 00000100:00100000:0.0:1788510448.548745:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852640128 00000100:00100000:0.0:1788510448.548794:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 70 00000100:00100000:0.0:1788510448.548801:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:10434:x1875388852640128:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788510448.548819:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510448.548836:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed658ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732d4 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.548945:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed658d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.548958:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed658d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.548967:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed658d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510448.548975:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788510448.549087:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed658d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.549108:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed658d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.549113:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed658d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.549117:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510448.549121:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed658d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.549127:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed658d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.549135:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578800) 00010000:00010000:0.0:1788510448.549137:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788510448.549141:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed658d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.549154:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed658d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.549188:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed658ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732d4 expref: 28 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.549198:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:0.0:1788510448.549200:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788510448.549204:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed658ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732d4 expref: 28 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.549214:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf800, rc 0) 00000100:00100000:0.0:1788510448.549288:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10434:x1875388852640128:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 487us (626us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788510448.549293:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 70 00000100:00100000:1.0:1788510448.551753:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510448.552117:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852640256 00000100:00100000:0.0:1788510448.552126:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852640256 00000100:00100000:0.0:1788510448.552179:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 71 00000100:00100000:0.0:1788510448.552191:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10434:x1875388852640256:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788510448.552244:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788510448.552324:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10434:x1875388852640256:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 136us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510448.552329:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 71 00000100:00100000:0.0:1788510448.556742:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510448.556918:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852640512 00000100:00100000:2.0:1788510448.556931:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852640512 00000100:00100000:2.0:1788510448.557021:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 72 00000100:00100000:2.0:1788510448.557818:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10434:x1875388852640512:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788510448.557842:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510448.557844:0:9544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788510448.557868:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6588b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732c6 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.557912:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:2.0:1788510448.557918:0:9544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788510448.557933:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed658df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732db expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788510448.558829:0:9544:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788510448.559314:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed658e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.559327:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed658e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.559335:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed658e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.559378:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed658df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732db expref: 29 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.559390:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed658e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732db expref: 28 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.559396:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578400) 00010000:00010000:2.0:1788510448.559398:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510448.559400:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77a00, rc 0) 00000100:00100000:2.0:1788510448.559454:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:10434:x1875388852640512:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 2425us (2721us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788510448.559459:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 72 00000100:00100000:0.0:1788510448.564119:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510448.564246:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852640768 00000100:00100000:2.0:1788510448.564256:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852640768 00000100:00100000:2.0:1788510448.564316:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 73 00000100:00100000:2.0:1788510448.564325:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:10434:x1875388852640768:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788510448.564382:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510448.564406:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed658e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732db expref: 28 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564421:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578400) 00010000:00010000:2.0:1788510448.564429:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788510448.564449:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed658f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564462:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed658f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564469:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed658f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564539:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed658fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x41ae0d10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564545:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed658fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x41ae0d10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564549:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed658fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x41ae0d10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564788:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed658f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564801:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed658f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564816:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed658f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564821:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510448.564825:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed658f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564831:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed658f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564837:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:2.0:1788510448.564838:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510448.564841:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed658f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564845:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed658f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564851:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed658fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x41ae0d10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564855:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed658fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x41ae0d10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564858:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed658fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x41ae0d10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564861:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510448.564867:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed658fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x41ae0d10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564871:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed658fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x41ae0d10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564878:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x41ae0d10 (ffff929aac578500) 00010000:00010000:2.0:1788510448.564881:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510448.564884:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed658fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x41ae0d10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.564890:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed658fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x41ae0d10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510448.564977:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10434:x1875388852640768:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 650us (874us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788510448.564984:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 73 00000100:00100000:0.0:1788510448.568363:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510448.568474:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852640896 00000100:00100000:2.0:1788510448.568482:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852640896 00000100:00100000:2.0:1788510448.570665:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 74 00000100:00100000:2.0:1788510448.570689:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10434:x1875388852640896:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788510448.570717:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510448.570746:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65902 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732e2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.570787:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.570799:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.570816:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.570906:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65902 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e2 expref: 29 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.570926:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e2 expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.570935:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578300) 00010000:00010000:2.0:1788510448.570939:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788510448.570942:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76600, rc 0) 00000100:00100000:2.0:1788510448.571006:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:10434:x1875388852640896:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 327us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510448.571013:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 74 00000100:00100000:1.0:1788510448.578503:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510448.584186:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852641152 00000100:00100000:2.0:1788510448.584203:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852641152 00000100:00100000:3.0:1788510448.588815:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 75 00000100:00100000:3.0:1788510448.588830:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:10434:x1875388852641152:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788510448.588930:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65910 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.588949:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.588961:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788510448.589314:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788510448.589324:0:5821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306408100805ns, next at 307408098670ns, rc = 0 00000004:00010000:3.0:1788510448.589409:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fbead295 reply state 000000005f7b2130 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510448.589418:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788510448.589525:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:10434:x1875388852641152:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 697us (11033us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788510448.589533:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 75 00000100:00100000:2.0:1788510448.604514:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00010000:00010000:3.0:1788510448.604798:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.604810:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65910 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.604818:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65910 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.604842:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510448.604847:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65910 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.604856:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65910 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.604872:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578300) 00010000:00010000:3.0:1788510448.604876:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788510448.604881:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65910 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.604888:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65910 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510448.604934:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852641280 00000100:00100000:3.0:1788510448.604944:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852641280 00000100:00100000:3.0:1788510448.605001:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 76 00000100:00100000:3.0:1788510448.605012:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+29:10434:x1875388852641280:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510448.605035:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510448.605051:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65917 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732e9 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.605111:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65917 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e9 expref: 30 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.605125:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65917 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e9 expref: 30 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.605155:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578300) 00010000:00010000:3.0:1788510448.605158:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788510448.605161:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69800, rc 0) 00000100:00100000:3.0:1788510448.605216:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:10434:x1875388852641280:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 206us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510448.605253:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 76 00000100:00100000:0.0:1788510448.610450:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510448.615806:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852641408 00000100:00100000:1.0:1788510448.615821:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852641408 00000100:00100000:1.0:1788510448.615871:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 25 00000100:00100000:1.0:1788510448.615880:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2339:x1875388852641408:12345-192.168.201.4@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788510448.615924:0:8183:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:1.0:1788510448.615954:0:8183:0:(genops.c:1385:class_connect()) connect: client cef40ebf-ceed-4c16-b27b-e8bced3a8d2f, cookie 0x3e734462ed6591e 00002000:00100000:1.0:1788510448.615964:0:8183:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cef40ebf-ceed-4c16-b27b-e8bced3a8d2f/ffff929abb3a5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788510448.615987:0:8183:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:1.0:1788510448.616197:0:8183:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788510448.618675:0:8183:0:(import.c:65:import_set_state_nolock()) ffff929abb3a4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788510448.618789:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2339:x1875388852641408:12345-192.168.201.4@tcp:8:lhsmtool_posix.0 Request processed in 2905us (8346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510448.618803:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 25 00000100:00100000:2.0:1788510448.625461:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510448.625528:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852641536 00000100:00100000:3.0:1788510448.625538:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852641536 00000100:00100000:3.0:1788510448.625604:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 26 00000100:00100000:3.0:1788510448.625616:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:0:x1875388852641536:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788510448.626972:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788510448.671189:0:11978:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510448.671200:0:11978:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510448.671271:0:11978:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788510448.671278:0:11978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:0.0:1788510448.713519:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000001:00080000:0.0:1788510448.715842:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1788510448.720733:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:0:x1875388852641536:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 Request processed in 95102us (95266us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788510448.720753:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 26 00000100:00100000:3.0:1788510448.734918:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510448.735247:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852641792 00000100:00100000:0.0:1788510448.735261:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852641792 00000100:00100000:0.0:1788510448.735328:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:0.0:1788510448.735338:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:10434:x1875388852641792:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788510448.735772:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:10434:x1875388852641792:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 434us (863us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788510448.735781:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:3.0:1788510448.741988:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510448.742082:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852642048 00000100:00100000:1.0:1788510448.742097:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852642048 00000100:00100000:1.0:1788510448.742176:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 77 00000100:00100000:1.0:1788510448.742199:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:10434:x1875388852642048:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788510448.742360:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:10434:x1875388852642048:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 165us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510448.742369:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 77 00000100:00100000:1.0:1788510448.756540:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510448.756619:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852642176 00000100:00100000:3.0:1788510448.756638:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852642176 00000100:00100000:3.0:1788510448.756699:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 78 00000100:00100000:3.0:1788510448.756710:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:10434:x1875388852642176:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510448.756731:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510448.756751:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65925 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732f0 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.756835:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed6592c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.756850:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed6592c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.756862:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed6592c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510448.756908:0:9544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510448.756928:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed6592c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.756954:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65925 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f0 expref: 33 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.756971:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed6592c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f0 expref: 32 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.756979:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578300) 00010000:00010000:3.0:1788510448.756982:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788510448.756986:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68c00, rc 0) 00000100:00100000:3.0:1788510448.757062:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:10434:x1875388852642176:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 354us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510448.757069:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 78 00000100:00100000:1.0:1788510448.759659:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510448.759745:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852642304 00000100:00100000:2.0:1788510448.759756:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852642304 00000100:00100000:2.0:1788510448.759821:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 27 00000100:00100000:2.0:1788510448.759834:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2343:x1875388852642304:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788510448.759855:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510448.759884:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006615e31f/0x3e734462ed65933 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732f7 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788510448.759946:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a80f0, blocks: 0x1 00010000:00010000:2.0:1788510448.759968:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=306s v=(0 0) 00010000:00010000:2.0:1788510448.759973:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510448.759983:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006615e31f/0x3e734462ed65933 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f7 expref: 6 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.760006:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006615e31f/0x3e734462ed65933 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f7 expref: 6 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.760020:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76000, rc 0) 00000100:00100000:2.0:1788510448.760101:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2343:x1875388852642304:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 268us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510448.760109:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 27 00000100:00100000:3.0:1788510448.765553:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510448.765643:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852642560 00000100:00100000:0.0:1788510448.765656:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852642560 00000100:00100000:0.0:1788510448.765725:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 79 00000100:00100000:0.0:1788510448.765736:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:10434:x1875388852642560:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788510448.765844:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:10434:x1875388852642560:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 110us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510448.765851:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 79 00000100:00100000:3.0:1788510448.776001:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510448.776152:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852642688 00000100:00100000:2.0:1788510448.776163:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852642688 00000100:00100000:2.0:1788510448.776246:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 28 00000100:00100000:2.0:1788510448.776257:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:10434:x1875388852642688:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788510448.776277:0:6667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510448.776296:0:6667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc732fe expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.776327:0:6667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006615e31f/0x3e734462ed65933 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f7 expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.776349:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510448.776353:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510448.776359:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 7 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.776398:0:6667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006615e31f/0x3e734462ed65933 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f7 expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.776412:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006615e31f/0x3e734462ed65933 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f7 expref: 7 pid: 6669 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510448.776426:0:6667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb2f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6667:1875388861056640:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510448.776537:0:6667:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c90480 going to sleep for 11 seconds 00000100:00100000:0.0:1788510448.786024:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510448.786077:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852642816 00000100:00100000:0.0:1788510448.786089:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852642816 00010000:00010000:0.0:1788510448.786136:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006615e31f/0x3e734462ed65933 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f7 expref: 8 pid: 6669 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510448.786184:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 42 00000100:00100000:0.0:1788510448.786194:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2341:x1875388852642816:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510448.786211:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510448.786260:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006615e31f/0x3e734462ed65933 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f7 expref: 8 pid: 6669 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.786274:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006615e31f/0x3e734462ed65933 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f7 expref: 8 pid: 6669 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.786301:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510448.786305:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510448.786315:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.786326:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.786396:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510448.786412:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae941880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1875388861056768:192.168.201.4@tcp:105: 00000100:00100000:0.0:1788510448.786511:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a91f20180 going to sleep for 11 seconds 00010000:00010000:1.0:1788510448.790364:0:6667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006615e31f/0x3e734462ed65933 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f7 expref: 8 pid: 6669 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510448.790388:0:6667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb2f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6667:1875388861056640:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510448.790421:0:6667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 7 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.790435:0:6667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76200, rc 0) 00000100:00100000:1.0:1788510448.791791:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:10434:x1875388852642688:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 15528us (15799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510448.791802:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 28 00000100:00100000:3.0:1788510448.807670:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510448.807879:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852642944 00000100:00100000:0.0:1788510448.807899:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852642944 00002000:00100000:0.0:1788510448.807956:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff929a88313800 x1875388852642944/t0(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:19/0 lens 504/0 e 0 to 0 dl 1788510459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788510448.807968:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929a88313800 with x1875388852642944 ext(0->8) 00002000:00010000:0.0:1788510448.807973:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929a88313800 00000100:00100000:0.0:1788510448.808012:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:0.0:1788510448.808022:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2342:x1875388852642944:12345-192.168.201.4@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788510448.809711:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2342:x1875388852642944:12345-192.168.201.4@tcp:4:lhsmtool_posix.0 Request processed in 1683us (2044us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788510448.809721:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 0 00002000:00100000:0.0:1788510448.809734:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff929a88313800 x1875388852642944/t4294967302(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:19/0 lens 504/448 e 0 to 0 dl 1788510459 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788510448.809745:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929a88313800 with x1875388852642944 ext(0->8) 00002000:00010000:0.0:1788510448.809750:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929a88313800 00000100:00100000:3.0:1788510448.813920:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510448.813960:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852643072 00000100:00100000:3.0:1788510448.813970:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852643072 00000100:00100000:3.0:1788510448.818169:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 80 00000100:00100000:3.0:1788510448.818194:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:10434:x1875388852643072:12345-192.168.201.4@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788510448.821391:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae941880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1875388861056768:192.168.201.4@tcp:105: 00010000:00010000:2.0:1788510448.821423:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510448.821498:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2341:x1875388852642816:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 35305us (35487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510448.821509:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 42 00010000:00010000:3.0:1788510448.904072:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510448.917817:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:10434:x1875388852643072:12345-192.168.201.4@tcp:44:lhsmtool_posix.0 Request processed in 99622us (103897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510448.917830:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 80 00000001:00080000:1.0:1788510448.917866:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788510448.917914:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788510448.917933:0:5843:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788510448.918056:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788510448.918066:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788510448.918093:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861056896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788510448.918144:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510448.918215:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861056896 00000100:00100000:1.0:1788510448.918249:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861056896 00000100:00100000:1.0:1788510448.918302:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788510448.918310:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861056896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788510448.918449:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788510448.918453:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788510448 00002000:00010000:1.0:1788510448.918456:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788510448.918458:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788510448 -> 1788510448 00002000:00010000:1.0:1788510448.918461:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788510448.918492:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861056896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (347us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788510448.918499:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788510448.918517:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788510448.918548:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929aaf0eed80/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788510448.918555:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861056896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788510448.921906:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510448.922094:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852643200 00000100:00100000:0.0:1788510448.922104:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852643200 00000100:00100000:0.0:1788510448.922196:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 30 00000100:00100000:0.0:1788510448.922254:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852643200:12345-192.168.201.4@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788510448.952987:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852643200:12345-192.168.201.4@tcp:16:lhsmtool_posix.0 Request processed in 30755us (31089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510448.953004:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 30 00000001:00080000:2.0:1788510448.954955:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1788510448.954982:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788510448.954994:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510448.955136:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852643456 00000100:00100000:0.0:1788510448.955384:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852643456 00000100:00100000:0.0:1788510448.955469:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 81 00000100:00100000:0.0:1788510448.955477:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:10434:x1875388852643456:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788510448.955530:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510448.955557:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed6592c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732f0 expref: 13 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.955576:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578300) 00010000:00010000:0.0:1788510448.955582:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510448.955610:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65941 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.955622:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65941 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.955631:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65941 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510448.955910:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dee3ea9 reply state 0000000010741b2c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65941 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510448.955917:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788510448.956013:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:10434:x1875388852643456:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 536us (1021us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788510448.956093:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 81 00010000:00010000:0.0:1788510448.957529:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65941 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.957544:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65941 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.957551:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65941 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.957558:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510448.957563:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65941 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.957571:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65941 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.957586:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578300) 00010000:00010000:0.0:1788510448.957589:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510448.957595:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65941 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.957602:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65941 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510448.958575:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510448.958685:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852643584 00000100:00100000:2.0:1788510448.958698:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852643584 00000100:00100000:2.0:1788510448.958867:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 31 00000100:00100000:2.0:1788510448.958879:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852643584:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788510448.959196:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788510448.959200:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788510448 -> 1788510447 00002000:00010000:2.0:1788510448.959203:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788510445 00002000:00010000:2.0:1788510448.959205:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788510448 -> 1788510447 00002000:00010000:2.0:1788510448.959208:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788510448.959307:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852643584:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 Request processed in 430us (740us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788510448.959317:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 31 00000100:00100000:1.0:1788510448.961188:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510448.961328:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852643840 00000100:00100000:3.0:1788510448.961338:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852643840 00000100:00100000:3.0:1788510448.961391:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 82 00000100:00100000:3.0:1788510448.961402:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:10434:x1875388852643840:12345-192.168.201.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788510448.961471:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.961485:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65909 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e2 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.961491:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.961593:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e2 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.961603:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65909 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e2 expref: 13 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510448.961613:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88311c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861057024:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510448.961701:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8577bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510448.962921:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88311c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861057024:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510448.962948:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510448.963647:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510448.963855:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852643968 00000100:00100000:1.0:1788510448.963862:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852643968 00010000:00010000:1.0:1788510448.963905:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65909 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e2 expref: 14 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510448.963989:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 43 00000100:00100000:1.0:1788510448.964000:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae941c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:2341:x1875388852643968:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510448.964082:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510448.964088:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65909 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e2 expref: 14 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.964098:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e2 expref: 14 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.964116:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e2 expref: 14 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.964127:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578300) 00010000:00010000:1.0:1788510448.964131:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.964137:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.964150:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.964177:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510448.964259:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae941c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2341:x1875388852643968:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 259us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510448.964265:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 43 00010000:00010000:2.0:1788510448.964326:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.964334:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.964365:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.964373:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.964380:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.964387:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510448.964392:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.964408:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.964418:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578300) 00010000:00010000:2.0:1788510448.964421:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788510448.964425:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.964432:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65948 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510448.964473:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+12:10434:x1875388852643840:12345-192.168.201.4@tcp:55:lhsmtool_posix.0 Request processed in 3073us (3295us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788510448.964481:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 82 00000100:00100000:3.0:1788510448.966308:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510448.966383:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852644096 00000100:00100000:1.0:1788510448.966390:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852644096 00000100:00100000:1.0:1788510448.966432:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 32 00000100:00100000:1.0:1788510448.966441:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852644096:12345-192.168.201.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788510448.966496:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.966511:0:6667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 7 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.966517:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510448.966520:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788510448.966524:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.966565:0:6667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 7 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.966581:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 7 pid: 6667 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510448.966597:0:6667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6667:1875388861057152:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510448.966672:0:6667:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a91f270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788510448.968071:0:6667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6667:1875388861057152:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510448.968096:0:6667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510448.970480:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510448.970647:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852644224 00000100:00100000:2.0:1788510448.970658:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852644224 00010000:00010000:2.0:1788510448.970703:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 8 pid: 6667 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510448.970786:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 44 00000100:00100000:2.0:1788510448.970808:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2341:x1875388852644224:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510448.970827:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510448.970855:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 8 pid: 6667 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.970867:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 8 pid: 6667 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.970926:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af0893a2/0x3e734462ed6593a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732fe expref: 8 pid: 6667 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.970946:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788510448.970952:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788510448.970958:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.970966:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.971054:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510448.971109:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852644224:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 316us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510448.971114:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 44 00010000:00010000:1.0:1788510448.971445:0:6667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.971469:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.971494:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.971503:0:6667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.971512:0:6667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.971520:0:6667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033400 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510448.971525:0:6667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.971536:0:6667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.971548:0:6667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.971557:0:6667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcb307c1/0x3e734462ed6594f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510448.971664:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852644096:12345-192.168.201.4@tcp:1:lhsmtool_posix.0 Request processed in 5223us (5441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510448.971673:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 32 00000100:00100000:1.0:1788510448.975940:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510448.976034:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852644480 00000100:00100000:3.0:1788510448.976046:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852644480 00000100:00100000:3.0:1788510448.976113:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 83 00000100:00100000:3.0:1788510448.976124:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+12:10434:x1875388852644480:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788510448.976256:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65956 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.976273:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.976285:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.976498:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.976511:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65917 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e9 expref: 13 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.976519:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.976553:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65917 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e9 expref: 13 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.976567:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65917 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e9 expref: 13 pid: 9544 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510448.976583:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88312d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861057280:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510448.976692:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8577bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788510448.980949:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510448.981276:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88312d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861057280:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510448.981312:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510448.982279:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852644608 00000100:00100000:1.0:1788510448.982291:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852644608 00010000:00010000:1.0:1788510448.982353:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65917 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e9 expref: 14 pid: 9544 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510448.982447:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 45 00000100:00100000:1.0:1788510448.982458:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae943100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:2341:x1875388852644608:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510448.982476:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510448.982482:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65917 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e9 expref: 14 pid: 9544 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.982495:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65917 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e9 expref: 14 pid: 9544 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.982523:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65917 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732e9 expref: 14 pid: 9544 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.982544:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578300) 00010000:00010000:1.0:1788510448.982549:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.982561:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.982588:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510448.982628:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510448.982699:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae943100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2341:x1875388852644608:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 243us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510448.982707:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 45 00010000:00010000:0.0:1788510448.982941:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.982950:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788510448.983255:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788510448.983420:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788510448.983473:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788510448.983574:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae941f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5821:1875388861057408:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788510448.983662:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510448.983706:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b333c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510448.983823:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861057408 00000100:00100000:2.0:1788510448.983830:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861057408 00000100:00100000:2.0:1788510448.983876:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510448.983885:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5821:x1875388861057408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788510448.983964:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5821:x1875388861057408:12345-0@lo:1000:mdt00_000.0 Request processed in 80us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510448.983971:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510448.984009:0:5821:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788510448.984014:0:5821:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff929aaf0eed80, transno 4294967303 00000100:00100000:2.0:1788510448.984027:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae941f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5821:1875388861057408:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788510448.984579:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788510448.984640:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb2f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5821:1875388861057536:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788510448.984676:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510448.984696:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc900 going to sleep for 11 seconds 00000100:00100000:2.0:1788510448.984899:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861057536 00000100:00100000:2.0:1788510448.984905:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861057536 00000100:00100000:2.0:1788510448.984939:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788510448.984947:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5821:x1875388861057536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788510448.985087:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5821:x1875388861057536:12345-0@lo:1000:mdt00_000.0 Request processed in 141us (409us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788510448.985094:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788510448.985129:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb2f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5821:1875388861057536:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788510448.985158:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985167:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985175:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985180:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510448.985184:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985192:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985208:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578300) 00010000:00010000:2.0:1788510448.985217:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788510448.985254:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985261:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed6595d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985294:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65892 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985300:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65892 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985306:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65892 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985311:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510448.985314:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65892 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985320:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65892 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985327:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578800) 00010000:00010000:2.0:1788510448.985329:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788510448.985332:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65892 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985338:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65892 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985356:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985378:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732cd expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985386:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985407:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732cd expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.985421:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732cd expref: 16 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510448.985432:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb2f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861057664:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510448.985484:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788510448.988735:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510448.988852:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb2f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861057664:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510448.988884:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510448.989091:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852644736 00000100:00100000:3.0:1788510448.989101:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852644736 00010000:00010000:3.0:1788510448.989167:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732cd expref: 17 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510448.989212:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 46 00000100:00100000:3.0:1788510448.989262:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae942a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:2341:x1875388852644736:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510448.989280:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510448.989288:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732cd expref: 17 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.989300:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732cd expref: 17 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.989323:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed658ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc732cd expref: 17 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.989342:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578800) 00010000:00010000:3.0:1788510448.989348:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.989358:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.989383:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510448.989409:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510448.989469:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae942a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:2341:x1875388852644736:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 246us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510448.989477:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 46 00010000:00010000:2.0:1788510448.989671:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989679:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989692:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989699:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989712:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989718:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510448.989723:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989730:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989740:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578800) 00010000:00010000:2.0:1788510448.989744:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510448.989747:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989754:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65964 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989767:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989774:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65956 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989780:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989785:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510448.989787:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989816:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65956 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989825:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578800) 00010000:00010000:2.0:1788510448.989828:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788510448.989830:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65956 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.989836:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65956 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510448.990104:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:10434:x1875388852644480:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 13974us (14166us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788510448.990115:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 83 00000020:00080000:2.0:1788510448.990120:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788510448.990805:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510448.990811:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510448.990840:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788510448.990846:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788510448.994517:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510448.994707:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852644992 00000100:00100000:3.0:1788510448.994718:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852644992 00000100:00100000:3.0:1788510448.994780:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:3.0:1788510448.994792:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:10434:x1875388852644992:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788510448.996618:0:5824:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788510448.996722:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788510448.996768:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed6596b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.996784:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed6596b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.996809:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed6596b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.996819:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed6596b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.996826:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed6596b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.996841:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed6596b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510448.996859:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788510448.997132:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510448.997139:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed6596b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.997146:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76a00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:0.0:1788510448.997150:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed6596b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.997159:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed6596b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.997172:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff929aac578300) 00010000:00010000:0.0:1788510448.997175:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788510448.997179:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed6596b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.997185:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed6596b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510448.997203:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510448.997205:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510448.997207:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510448.997527:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:10434:x1875388852644992:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 2733us (3025us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788510448.997537:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 20 00000020:00080000:2.0:1788510448.997543:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788510449.772742:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510449.773216:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852645120 00000100:00100000:0.0:1788510449.773261:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852645120 00000100:00100000:0.0:1788510449.773332:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 288 00000100:00100000:0.0:1788510449.773343:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2340:x1875388852645120:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510449.773426:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2340:x1875388852645120:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 84us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510449.773433:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 288 00000100:00100000:1.0:1788510449.793342:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510449.793396:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510449.793424:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510449.793479:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510449.793536:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852645376 00000100:00100000:1.0:1788510449.793547:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852645376 00000100:00100000:1.0:1788510449.793616:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852645504 00000100:00100000:1.0:1788510449.793620:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852645504 00000100:00100000:1.0:1788510449.793645:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 77 00000100:00100000:1.0:1788510449.793656:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaefeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852645376:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510449.793985:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaefeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852645376:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 329us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510449.793995:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 77 00000100:00100000:1.0:1788510449.794192:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 78 00000100:00100000:1.0:1788510449.794200:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852645504:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510449.794271:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852645504:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 72us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510449.794278:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 78 00000100:00080000:1.0:1788510449.794317:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510449.795177:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852645632 00000100:00100000:0.0:1788510449.795186:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852645632 00000100:00100000:0.0:1788510449.795279:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852645248 00000100:00100000:0.0:1788510449.795283:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852645248 00000100:00100000:0.0:1788510449.795308:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 140 00000100:00100000:0.0:1788510449.795317:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852645632:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510449.795382:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2340:x1875388852645632:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 66us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510449.795390:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 140 00000100:00100000:0.0:1788510449.795406:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 141 00000100:00100000:0.0:1788510449.795412:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:2340:x1875388852645248:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510449.795443:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:2340:x1875388852645248:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 31us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510449.795449:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 141 00000100:00080000:1.0:1788510449.798396:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788510449.929940:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510450.373069:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861057792:0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373131:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510450.373164:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861058304:0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373181:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510450.373199:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510450.373202:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861058176:0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373216:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510450.373252:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861057920:0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373268:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510450.373285:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861058432:0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373304:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510450.373320:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510450.373325:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861058048:0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373343:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510450.373366:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861057792 00000100:00100000:1.0:1788510450.373372:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861057792 00000100:00100000:1.0:1788510450.373405:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788510450.373411:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861057792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373443:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861057792:12345-0@lo:400:kworker.0 Request processed in 33us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510450.373448:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788510450.373471:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861058304 00000100:00100000:1.0:1788510450.373474:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861058304 00000100:00100000:1.0:1788510450.373494:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861057920 00000100:00100000:1.0:1788510450.373496:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861057920 00000100:00100000:1.0:1788510450.373511:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861058048 00000100:00100000:1.0:1788510450.373513:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861058048 00000100:00100000:1.0:1788510450.373521:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788510450.373525:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861058304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373552:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861058304:12345-0@lo:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510450.373558:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788510450.373568:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788510450.373573:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861057920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373602:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861057920:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510450.373607:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788510450.373616:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788510450.373620:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861058048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373637:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861058048:12345-0@lo:400:kworker.0 Request processed in 17us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510450.373641:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788510450.373652:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861058176 00000100:00100000:1.0:1788510450.373654:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861058176 00000100:00100000:1.0:1788510450.373671:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861058432 00000100:00100000:1.0:1788510450.373674:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861058432 00000100:00100000:1.0:1788510450.373694:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788510450.373701:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861058176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373728:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861058176:12345-0@lo:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510450.373734:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788510450.373744:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788510450.373757:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1875388861058432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373785:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1875388861058432:12345-0@lo:400:kworker.0 Request processed in 29us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510450.373790:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788510450.373819:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510450.373823:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788510450.373826:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510450.373886:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861058048:0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373898:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861057920:0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373907:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861058432:0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373942:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861058176:0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373950:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861057792:0@lo:400:kworker.0 00000100:00100000:1.0:1788510450.373958:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861058304:0@lo:400:kworker.0 00000040:00080000:1.0:1788510450.742982:0:12030:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788510450.742996:0:12030:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788510450.743033:0:12030:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788510450.743038:0:12030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788510450.876349:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510450.876465:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852645888 00000100:00100000:0.0:1788510450.876480:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852645888 00000100:00100000:0.0:1788510450.876565:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 84 00000100:00100000:0.0:1788510450.876579:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:10453:x1875388852645888:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510450.876610:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510450.876655:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73305 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510450.876799:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65979 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510450.876836:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510450.877091:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510450.877105:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788510450.877357:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73305 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510450.877375:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65979 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73305 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510450.877384:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:0.0:1788510450.877386:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788510450.877390:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafc00, rc 0) 00000100:00100000:0.0:1788510450.877490:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:10453:x1875388852645888:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 913us (1156us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788510450.877497:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 84 00000100:00100000:0.0:1788510450.883412:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510450.883535:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852646016 00000100:00100000:3.0:1788510450.883546:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852646016 00000100:00100000:3.0:1788510450.883608:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 85 00000100:00100000:3.0:1788510450.883619:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:10453:x1875388852646016:12345-192.168.201.4@tcp:34:lfs.0 00010000:00010000:3.0:1788510450.883706:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65987 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.883726:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.883739:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.883778:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed6598e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.883786:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed6598e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.883792:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed6598e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884516:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884526:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884535:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788510450.884578:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884592:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884599:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65987 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884607:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884614:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510450.884618:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884631:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65987 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884644:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:3.0:1788510450.884648:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510450.884653:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65987 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884660:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65987 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884671:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed6598e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884677:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed6598e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884683:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed6598e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884688:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510450.884690:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed6598e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884696:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed6598e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884702:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a83eab200) 00010000:00010000:3.0:1788510450.884705:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510450.884707:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed6598e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884721:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed6598e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884735:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884741:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65995 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.884993:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.885001:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510450.885005:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.885011:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65995 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.885019:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a83eab500) 00010000:00010000:3.0:1788510450.885021:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510450.885024:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65995 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510450.885029:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510450.885177:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:10453:x1875388852646016:12345-192.168.201.4@tcp:34:lfs.0 Request processed in 1556us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510450.885187:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 85 00000100:00100000:1.0:1788510450.891444:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861058560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788510450.902047:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510450.902139:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861058560 00000100:00100000:1.0:1788510450.902966:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861058560 00000100:00100000:1.0:1788510450.903043:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788510450.903057:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875388861058560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788510450.903113:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510450.903202:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875388861058560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510450.903209:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788510450.903352:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861058560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510450.954665:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510450.954706:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852646272 00000100:00100000:2.0:1788510450.954718:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852646272 00000100:00100000:2.0:1788510450.954775:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 86 00000100:00100000:2.0:1788510450.954785:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:10456:x1875388852646272:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510450.954959:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510450.955182:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510450.955210:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed6599c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7330c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.955312:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.955326:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.955335:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.955345:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed659aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.955356:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed659aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.955360:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed659aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.958234:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed659b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.958263:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed659b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.958275:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed659b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510450.958293:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788510450.958407:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.958413:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.958418:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.958422:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510450.958426:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.958432:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.958451:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:2.0:1788510450.958453:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510450.958457:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.958461:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.959551:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed659aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.959566:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed659aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.959572:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed659aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.959576:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510450.959579:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed659aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.959584:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed659aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.959595:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929aac578a00) 00010000:00010000:2.0:1788510450.959597:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510450.959600:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed659aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.959604:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed659aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.959680:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed6599c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7330c expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.959691:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed659b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7330c expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.959696:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:2.0:1788510450.959697:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510450.959699:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76a00, rc 0) 00000100:00100000:2.0:1788510450.959784:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10456:x1875388852646272:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 4999us (5132us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788510450.959793:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 86 00000100:00100000:2.0:1788510450.964339:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510450.964372:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852646400 00000100:00100000:2.0:1788510450.964384:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852646400 00000100:00100000:2.0:1788510450.964445:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 87 00000100:00100000:2.0:1788510450.964455:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10456:x1875388852646400:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:2.0:1788510450.964548:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed659bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.964569:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed659bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.964580:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed659bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.964608:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed659bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.964624:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed659bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.964632:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed659bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.964638:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510450.964643:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed659bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.964649:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed659bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.964659:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:2.0:1788510450.964662:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788510450.964667:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed659bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510450.964672:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed659bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510450.966289:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10456:x1875388852646400:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 1824us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510450.966306:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 87 00000100:00100000:2.0:1788510450.970627:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510450.971719:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852646656 00000100:00100000:3.0:1788510450.971742:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852646656 00000100:00100000:3.0:1788510450.971897:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:3.0:1788510450.971910:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10456:x1875388852646656:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510450.972998:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:10456:x1875388852646656:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 1086us (2376us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788510450.973008:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 21 00000001:00080000:0.0:1788510450.974298:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1788510450.974323:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788510451.026579:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510451.027963:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852646912 00000100:00100000:0.0:1788510451.028012:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852646912 00000100:00100000:1.0:1788510451.031244:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 88 00000100:00100000:1.0:1788510451.031272:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:9977:x1875388852646912:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:1.0:1788510451.031308:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510451.031339:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed659c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73313 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.031473:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.031491:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed659b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7330c expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.031501:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.031542:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed659b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7330c expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.031556:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed659b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7330c expref: 23 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510451.031572:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861058688:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510451.031688:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aac6b7240 going to sleep for 11 seconds 00000100:00080000:2.0:1788510451.032326:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510451.036315:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861058688:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510451.036357:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510451.041198:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.041363:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852647040 00000100:00100000:1.0:1788510451.041379:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852647040 00010000:00010000:1.0:1788510451.041443:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed659b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7330c expref: 24 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510451.041567:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 47 00000100:00100000:1.0:1788510451.041579:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:2341:x1875388852647040:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510451.041597:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510451.041604:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed659b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7330c expref: 24 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.041619:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed659b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7330c expref: 24 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.041641:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed659b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7330c expref: 24 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.041672:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:1.0:1788510451.041679:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.041689:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.041697:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.041754:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510451.042166:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.042176:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510451.042198:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788510451.042410:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed659c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73313 expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.042429:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73313 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.042437:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:0.0:1788510451.042440:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788510451.042443:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033e00, rc 0) 00000100:00100000:0.0:1788510451.042474:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:9977:x1875388852646912:12345-192.168.201.4@tcp:101:bash.0 Request processed in 11213us (15911us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788510451.042484:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 88 00000100:00100000:1.0:1788510451.043332:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:2341:x1875388852647040:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 251us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510451.043356:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 47 00000100:00100000:3.0:1788510451.050467:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510451.050632:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852647296 00000100:00100000:0.0:1788510451.050643:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852647296 00000100:00100000:0.0:1788510451.051113:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 89 00000100:00100000:0.0:1788510451.051136:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:9977:x1875388852647296:12345-192.168.201.4@tcp:36:bash.0 00010000:00010000:0.0:1788510451.051528:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed659db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.051552:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed659db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.051589:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed659db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788510451.051647:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788510451.051691:0:9544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a25672c6 reply state 00000000fde1a0b2 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed659db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510451.051703:0:9544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788510451.051752:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788510451.052090:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:9977:x1875388852647296:12345-192.168.201.4@tcp:36:bash.0 Request processed in 964us (1635us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788510451.052099:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 89 00000020:00080000:0.0:1788510451.052105:0:9544:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788510451.061796:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed659db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.061816:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed659db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.061824:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed659db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.061911:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510451.061917:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed659db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.061928:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed659db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.061951:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:3.0:1788510451.061954:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510451.061959:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed659db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.061966:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed659db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510451.065556:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510451.066067:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852647424 00000100:00100000:2.0:1788510451.066078:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852647424 00000100:00100000:2.0:1788510451.066181:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 90 00000100:00100000:2.0:1788510451.066192:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:9977:x1875388852647424:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510451.066251:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510451.066276:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed659e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7331a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.066348:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed659e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7331a expref: 27 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.066366:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed659e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7331a expref: 27 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.066391:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:2.0:1788510451.066395:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788510451.066400:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76c00, rc 0) 00000100:00100000:2.0:1788510451.066469:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:9977:x1875388852647424:12345-192.168.201.4@tcp:101:bash.0 Request processed in 279us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510451.066477:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 90 00000100:00100000:2.0:1788510451.075383:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.075494:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852647552 00000100:00100000:1.0:1788510451.075508:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852647552 00000100:00100000:1.0:1788510451.075621:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00100000:1.0:1788510451.075638:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:9977:x1875388852647552:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:1.0:1788510451.075683:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510451.075712:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed659e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73321 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788510451.075749:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9a80ef, atime: 0x6a9a80ed, ctime: 0x6a9a80ef, blocks: 0xb 00010000:00010000:1.0:1788510451.075774:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=308s v=(0 0) 00010000:00010000:1.0:1788510451.075779:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510451.075787:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed659e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73321 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.076000:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed659e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73321 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.076016:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033200, rc 0) 00000100:00100000:1.0:1788510451.076097:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:9977:x1875388852647552:12345-192.168.201.4@tcp:101:bash.0 Request processed in 465us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510451.076104:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00080000:2.0:1788510451.077301:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788510451.090683:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.090863:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852647680 00000100:00100000:1.0:1788510451.090874:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852647680 00002000:00010000:1.0:1788510451.090916:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788510451.090921:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929a88312a00 with x1875388852647680 ext(0->18446744073709551615) 00002000:00010000:1.0:1788510451.090931:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929a88312a00. 00000100:00100000:1.0:1788510451.090964:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 1 00000100:00100000:1.0:1788510451.090975:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852647680:12345-192.168.201.4@tcp:10:bash.0 00002000:00010000:1.0:1788510451.091359:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788510451.091364:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788510447 -> 1788510451 00002000:00010000:1.0:1788510451.091367:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788510445 -> 1788510445 00002000:00010000:1.0:1788510451.091369:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788510447 -> 1788510451 00002000:00010000:1.0:1788510451.091372:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788510451.091436:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852647680:12345-192.168.201.4@tcp:10:bash.0 Request processed in 462us (782us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788510451.091445:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 1 00002000:00010000:1.0:1788510451.091450:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788510451.091452:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929a88312a00 with x1875388852647680 ext(0->18446744073709551615) 00002000:00010000:1.0:1788510451.091457:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929a88312a00. 00000100:00100000:0.0:1788510451.264412:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510451.264521:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852647808 00000100:00100000:2.0:1788510451.264532:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852647808 00000100:00100000:2.0:1788510451.264626:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 91 00000100:00100000:2.0:1788510451.264637:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10470:x1875388852647808:12345-192.168.201.4@tcp:34:lfs.0 00010000:00010000:2.0:1788510451.264764:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.264789:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.264841:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.264875:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed659f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.264883:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed659f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.264891:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed659f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265173:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed659fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265185:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed659fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265192:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed659fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788510451.265281:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed659fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265294:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265299:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265304:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265318:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510451.265323:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265330:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265341:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:2.0:1788510451.265344:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510451.265348:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265354:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed659f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265366:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed659f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265369:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed659f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265372:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed659f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265376:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510451.265377:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed659f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265380:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed659f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265391:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929aac578a00) 00010000:00010000:2.0:1788510451.265393:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510451.265395:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed659f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265398:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed659f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265411:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed659fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265416:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed659fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265419:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed659fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265422:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510451.265424:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed659fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265427:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed659fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265433:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:2.0:1788510451.265435:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510451.265437:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed659fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.265441:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed659fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510451.265556:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10470:x1875388852647808:12345-192.168.201.4@tcp:34:lfs.0 Request processed in 919us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510451.265565:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 91 00000100:00100000:2.0:1788510451.358506:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510451.358701:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852648064 00000100:00100000:3.0:1788510451.358712:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852648064 00000100:00100000:3.0:1788510451.358786:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 92 00000100:00100000:3.0:1788510451.358800:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:10473:x1875388852648064:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:3.0:1788510451.358835:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510451.358869:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65a05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73328 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.358956:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65a0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.358973:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65a0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.358983:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65a0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.358997:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65a13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.359004:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.359011:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.359338:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65a1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.359357:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.359364:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510451.359376:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788510451.360726:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65a0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.360740:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65a0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.360748:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65a0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.360754:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510451.360759:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65a0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.360766:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65a0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.360781:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:3.0:1788510451.360784:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510451.360790:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65a0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.360797:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65a0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.360816:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.361745:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65a13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.361753:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.361759:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510451.361763:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.361773:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.361799:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a83eab500) 00010000:00010000:3.0:1788510451.361802:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510451.361806:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65a13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.361814:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.361994:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65a05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73328 expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.362012:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73328 expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.362020:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:3.0:1788510451.362022:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788510451.362034:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69000, rc 0) 00000100:00100000:3.0:1788510451.362204:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+29:10473:x1875388852648064:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 3405us (3709us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788510451.362214:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 92 00000100:00100000:3.0:1788510451.384176:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510451.384299:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852648192 00000100:00100000:2.0:1788510451.384311:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852648192 00000100:00100000:2.0:1788510451.384376:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 93 00000100:00100000:2.0:1788510451.384385:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+29:10473:x1875388852648192:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:2.0:1788510451.384444:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.384457:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73313 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.384473:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.384502:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73313 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.384515:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73313 expref: 29 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510451.384530:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb2f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861058816:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510451.384635:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788510451.394770:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510451.395035:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb2f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861058816:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510451.395081:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510451.395658:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852648448 00000100:00100000:3.0:1788510451.395667:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852648448 00000100:00100000:3.0:1788510451.395728:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:3.0:1788510451.395739:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:5581:x1875388852648448:12345-192.168.201.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788510451.396157:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:5581:x1875388852648448:12345-192.168.201.4@tcp:35:ldlm_bl.0 Request processed in 418us (1399us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788510451.396165:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:3.0:1788510451.402770:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510451.402889:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852648576 00000100:00100000:0.0:1788510451.402902:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852648576 00010000:00010000:0.0:1788510451.402946:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73313 expref: 31 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510451.402989:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 48 00000100:00100000:0.0:1788510451.403000:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:2341:x1875388852648576:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510451.403017:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510451.403023:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73313 expref: 31 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.403036:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73313 expref: 31 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.403076:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed659cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73313 expref: 31 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.403091:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:0.0:1788510451.403097:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.403106:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.403114:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.403148:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510451.403204:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:2341:x1875388852648576:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 206us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510451.403212:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 48 00010000:00010000:2.0:1788510451.403787:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.403799:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.403833:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.403840:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.403856:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.403861:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510451.403865:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.403871:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.403882:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:2.0:1788510451.403885:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788510451.403888:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.403894:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65a28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510451.403952:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+29:10473:x1875388852648192:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 19566us (19784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510451.403961:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 93 00000100:00100000:2.0:1788510451.407198:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510451.407330:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852648832 00000100:00100000:0.0:1788510451.407342:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852648832 00000100:00100000:0.0:1788510451.407408:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 23 00000100:00100000:0.0:1788510451.407420:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+29:10473:x1875388852648832:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:0.0:1788510451.407728:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:10473:x1875388852648832:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 309us (538us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788510451.407737:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 23 00000100:00100000:1.0:1788510451.526716:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510451.526824:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852649088 00000100:00100000:0.0:1788510451.526838:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852649088 00000100:00100000:0.0:1788510451.526919:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 94 00000100:00100000:0.0:1788510451.526947:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:10484:x1875388852649088:12345-192.168.201.4@tcp:101:cat.0 00010000:00010000:0.0:1788510451.526970:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510451.526991:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7332f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527068:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527083:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527096:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527110:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527117:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527124:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527395:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65a44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527402:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527408:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510451.527422:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788510451.527526:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527536:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527543:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527549:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510451.527554:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527562:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527576:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:0.0:1788510451.527580:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510451.527585:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527591:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527604:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527610:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527615:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527626:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510451.527629:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527636:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527644:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a8b8f5000) 00010000:00010000:0.0:1788510451.527646:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510451.527649:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527655:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527694:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7332f expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527709:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7332f expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.527715:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:0.0:1788510451.527717:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510451.527720:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf000, rc 0) 00000100:00100000:0.0:1788510451.527794:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:10484:x1875388852649088:12345-192.168.201.4@tcp:101:cat.0 Request processed in 849us (1091us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788510451.527802:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 94 00000100:00100000:1.0:1788510451.543015:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510451.543122:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852649344 00000100:00100000:0.0:1788510451.543149:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852649344 00000100:00100000:0.0:1788510451.543254:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 24 00000100:00100000:0.0:1788510451.543268:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:10484:x1875388852649344:12345-192.168.201.4@tcp:35:cat.0 00000100:00100000:0.0:1788510451.543530:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+33:10484:x1875388852649344:12345-192.168.201.4@tcp:35:cat.0 Request processed in 264us (525us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788510451.543538:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 24 00000100:00100000:2.0:1788510451.584381:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510451.584541:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852649600 00000100:00100000:0.0:1788510451.584552:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852649600 00000100:00100000:0.0:1788510451.584758:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 95 00000100:00100000:0.0:1788510451.584770:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+33:10485:x1875388852649600:12345-192.168.201.4@tcp:36:rm.0 00010000:00010000:0.0:1788510451.584838:0:9544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788510451.584874:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65a44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7332f expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.584900:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65a1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73328 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.584914:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed659e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7331a expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.584924:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929aac578c00) 00010000:00010000:0.0:1788510451.584936:0:9544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510451.584959:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.584973:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.585003:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.585019:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.585026:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.585032:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.585378:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.585387:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.585394:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788510451.586364:0:9544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788510451.586375:0:9544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 309405151251ns, next at 310405148668ns, rc = 0 00010000:00010000:0.0:1788510451.586438:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65a67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.586449:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65a67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587189:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65a67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587215:0:9544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65a67 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587250:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65a67 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587257:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65a67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587589:0:9544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788510451.587615:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587622:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587628:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587634:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510451.587639:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587647:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a60 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587660:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a8b8f5a00) 00010000:00010000:0.0:1788510451.587663:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788510451.587667:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587795:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587822:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587828:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587834:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587839:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafa00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510451.587917:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587925:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587934:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:0.0:1788510451.587937:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510451.587940:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.587945:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510451.587956:0:9544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cec2ea9e reply state 00000000d52e19f0 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510451.587965:0:9544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788510451.589073:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:10485:x1875388852649600:12345-192.168.201.4@tcp:36:rm.0 Request processed in 4295us (4697us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788510451.589085:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 95 00010000:00010000:3.0:1788510451.592608:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510451.592622:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65a67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.592634:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510451.592638:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65a67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.592649:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65a67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.592668:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff929a8b8f5a00) 00010000:00010000:3.0:1788510451.592950:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788510451.592957:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65a67 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.592963:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65a67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.593005:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510451.593007:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510451.593009:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510451.593975:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.593991:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.593998:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.594003:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510451.594008:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.594016:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.594031:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a8b8f5000) 00010000:00010000:0.0:1788510451.594034:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510451.594037:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.594044:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510451.637339:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510451.637749:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852649856 00000100:00100000:0.0:1788510451.637760:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852649856 00000100:00100000:0.0:1788510451.637819:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 96 00000100:00100000:0.0:1788510451.637828:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:10491:x1875388852649856:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:0.0:1788510451.637863:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510451.637885:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73336 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.638014:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.638027:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.638039:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.638052:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.638059:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.638065:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788510451.638937:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788510451.639103:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65a83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.639116:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.639138:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.639175:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.639182:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.639189:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.639195:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafa00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510451.639199:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.639207:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.639218:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:1.0:1788510451.639243:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510451.639248:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.639254:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65a75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788510451.639267:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088812253 reply state 00000000ad188c55 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510451.639276:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788510451.639312:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65a6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73336 expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.639325:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73336 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.639332:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92000) 00010000:00010000:1.0:1788510451.639334:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788510451.639337:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032a00, rc 0) 00000100:00100000:1.0:1788510451.639412:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+34:10491:x1875388852649856:12345-192.168.201.4@tcp:101:bash.0 Request processed in 1584us (2081us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788510451.639420:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 96 00010000:00010000:3.0:1788510451.642347:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.642364:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.642372:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.642378:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510451.642382:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.642391:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.642408:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a8b8f5000) 00010000:00010000:3.0:1788510451.642411:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510451.642416:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.642422:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65a7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510451.643426:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.643801:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852649984 00000100:00100000:1.0:1788510451.643811:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852649984 00000100:00100000:1.0:1788510451.643935:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 34 00000100:00100000:1.0:1788510451.643946:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852649984:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:1.0:1788510451.643966:0:6667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510451.643985:0:6667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091e108cb/0x3e734462ed65a91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7333d expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788510451.644010:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510451.644035:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=309s v=(0 0) 00010000:00010000:1.0:1788510451.644041:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510451.644051:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091e108cb/0x3e734462ed65a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7333d expref: 6 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.644082:0:6667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091e108cb/0x3e734462ed65a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7333d expref: 6 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.644120:0:6667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032200, rc 0) 00000100:00100000:1.0:1788510451.644186:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852649984:12345-192.168.201.4@tcp:101:bash.0 Request processed in 241us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510451.644192:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 34 00000100:00080000:2.0:1788510451.644433:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510451.649943:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510451.650037:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852650112 00000100:00100000:2.0:1788510451.650047:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852650112 00000100:00100000:2.0:1788510451.650157:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 35 00000100:00100000:2.0:1788510451.650169:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:10491:x1875388852650112:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510451.650188:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510451.650207:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73344 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.650289:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091e108cb/0x3e734462ed65a91 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7333d expref: 7 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.650301:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510451.650306:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510451.650312:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.650347:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091e108cb/0x3e734462ed65a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7333d expref: 7 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.650383:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091e108cb/0x3e734462ed65a91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7333d expref: 7 pid: 6667 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510451.650399:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1875388861058944:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510451.650488:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788510451.653501:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.653591:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852650240 00000100:00100000:1.0:1788510451.653601:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852650240 00010000:00010000:1.0:1788510451.653644:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091e108cb/0x3e734462ed65a91 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7333d expref: 8 pid: 6667 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510451.653691:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00100000:1.0:1788510451.653703:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852650240:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510451.653722:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510451.653750:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091e108cb/0x3e734462ed65a91 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7333d expref: 8 pid: 6667 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.653766:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091e108cb/0x3e734462ed65a91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7333d expref: 8 pid: 6667 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.653796:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510451.653802:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510451.653812:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.653858:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.653913:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510451.653930:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1875388861059072:192.168.201.4@tcp:105: 00000100:00100000:1.0:1788510451.654022:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aafdf4780 going to sleep for 11 seconds 00010000:00010000:2.0:1788510451.654308:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091e108cb/0x3e734462ed65a91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7333d expref: 8 pid: 6667 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510451.654326:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1875388861058944:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510451.654352:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.654365:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76000, rc 0) 00000100:00100000:2.0:1788510451.654411:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:10491:x1875388852650112:12345-192.168.201.4@tcp:101:bash.0 Request processed in 4245us (4479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510451.654420:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 35 00000100:00100000:0.0:1788510451.657272:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.657412:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1875388861059072:192.168.201.4@tcp:105: 00010000:00010000:1.0:1788510451.657430:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510451.657477:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852650240:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 3777us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510451.657488:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00100000:2.0:1788510451.657715:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852650496 00000100:00100000:2.0:1788510451.657722:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852650496 00000100:00100000:2.0:1788510451.657776:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 25 00000100:00100000:2.0:1788510451.657785:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+33:10491:x1875388852650496:12345-192.168.201.4@tcp:35:bash.0 00000100:00100000:2.0:1788510451.658123:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+34:10491:x1875388852650496:12345-192.168.201.4@tcp:35:bash.0 Request processed in 326us (849us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788510451.658131:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 25 00000100:00100000:1.0:1788510451.865370:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510451.865455:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852650624 00000100:00100000:2.0:1788510451.865472:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852650624 00000100:00100000:2.0:1788510451.867270:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 97 00000100:00100000:2.0:1788510451.867292:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+34:10507:x1875388852650624:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510451.867319:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510451.867341:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65a9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7334b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.867404:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65aa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.867421:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.867434:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510451.867475:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788510451.867478:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510451.867499:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.867657:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65a9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7334b expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.867680:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7334b expref: 35 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.867689:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:2.0:1788510451.867692:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510451.867716:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77200, rc 0) 00000100:00100000:2.0:1788510451.867910:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+35:10507:x1875388852650624:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 627us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510451.867919:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 97 00000100:00100000:2.0:1788510451.879447:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.879869:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852650880 00000100:00100000:1.0:1788510451.879883:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852650880 00000100:00100000:1.0:1788510451.879962:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 98 00000100:00100000:1.0:1788510451.879975:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+35:10507:x1875388852650880:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510451.879998:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510451.880024:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65aad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73352 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.882259:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65ab4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.882310:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.882325:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510451.882344:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788510451.882515:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65aad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73352 expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.882539:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73352 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.882550:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92000) 00010000:00010000:1.0:1788510451.882553:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788510451.882557:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033e00, rc 0) 00000100:00100000:1.0:1788510451.882632:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+37:10507:x1875388852650880:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 2659us (3194us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788510451.882640:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 98 00000100:00100000:3.0:1788510451.889328:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510451.889373:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.889491:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852651136 00000100:00100000:1.0:1788510451.889501:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852651136 00000100:00100000:1.0:1788510451.889568:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 99 00000100:00100000:1.0:1788510451.889580:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+37:10507:x1875388852651136:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510451.889604:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510451.889623:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65ac2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73359 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.889738:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65ac9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.889754:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.889766:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510451.889778:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788510451.889914:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65ac2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73359 expref: 40 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.889932:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65ac9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73359 expref: 39 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.889941:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92000) 00010000:00010000:1.0:1788510451.889945:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788510451.889948:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032400, rc 0) 00000100:00100000:1.0:1788510451.890001:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+39:10507:x1875388852651136:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 423us (683us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788510451.890008:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 99 00000100:00100000:2.0:1788510451.890313:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852651264 00000100:00100000:2.0:1788510451.890319:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852651264 00000100:00100000:2.0:1788510451.890359:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:2.0:1788510451.890368:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+39:2341:x1875388852651264:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510451.890378:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510451.890392:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65ab4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73352 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.890405:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92000) 00010000:00010000:2.0:1788510451.890409:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510451.890432:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+38:2341:x1875388852651264:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 66us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510451.890438:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:2.0:1788510451.899287:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510451.899396:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852651392 00000100:00100000:3.0:1788510451.899420:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852651392 00000100:00100000:3.0:1788510451.899481:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 36 00000100:00100000:3.0:1788510451.899498:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852651392:12345-192.168.201.4@tcp:1:lfs.0 00010000:00010000:3.0:1788510451.899745:0:8183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.899771:0:8183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.899781:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788510451.899785:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788510451.899790:0:8183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.899835:0:8183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.899861:0:8183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 6 pid: 6669 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510451.899875:0:8183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88311c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8183:1875388861059200:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510451.899977:0:8183:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a877b8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510451.903948:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510451.904175:0:8183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88311c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8183:1875388861059200:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510451.904209:0:8183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510451.904394:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852651520 00000100:00100000:0.0:1788510451.904401:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852651520 00002000:00100000:0.0:1788510451.904447:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff929aaf0ec700 x1875388852651520/t0(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:22/0 lens 504/0 e 0 to 0 dl 1788510462 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788510451.904673:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aaf0ec700 with x1875388852651520 ext(0->8) 00010000:00010000:0.0:1788510451.904682:0:6674:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 7 pid: 6669 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.904697:0:6674:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 7 pid: 6669 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788510451.904713:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff929aaf0ec700 00000100:00100000:0.0:1788510451.904749:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 1 00000100:00100000:0.0:1788510451.904759:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852651520:12345-192.168.201.4@tcp:4:lfs.0 00000100:00100000:0.0:1788510451.906091:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2341:x1875388852651520:12345-192.168.201.4@tcp:4:lfs.0 Request processed in 1326us (2146us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788510451.906101:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 1 00002000:00100000:0.0:1788510451.906112:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff929aaf0ec700 x1875388852651520/t4294967302(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:22/0 lens 504/448 e 0 to 0 dl 1788510462 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788510451.906121:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aaf0ec700 with x1875388852651520 ext(0->8) 00010000:00010000:0.0:1788510451.906129:0:6674:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 9 pid: 6669 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510451.906145:0:6674:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 9 pid: 6669 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788510451.906152:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff929aaf0ec700 00000100:00100000:0.0:1788510451.909175:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.909382:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852651648 00000100:00100000:1.0:1788510451.909394:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852651648 00010000:00010000:1.0:1788510451.909438:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 9 pid: 6669 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510451.909493:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 50 00000100:00100000:1.0:1788510451.909518:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae941500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2342:x1875388852651648:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510451.909543:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788510451.909564:0:5807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788510451.909567:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788510451 00002000:00010000:1.0:1788510451.909569:0:5807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788510451 00002000:00010000:1.0:1788510451.909572:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788510451 00010000:00010000:1.0:1788510451.909579:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 9 pid: 6669 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.909595:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 9 pid: 6669 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.909619:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed65a98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73344 expref: 9 pid: 6669 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.909639:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788510451.909644:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788510451.909650:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.909660:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.909694:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510451.909763:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae941500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2342:x1875388852651648:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 246us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510451.909771:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 50 00010000:00010000:3.0:1788510451.910389:0:8183:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.910401:0:8183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.910426:0:8183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.910433:0:8183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.910442:0:8183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.910449:0:8183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68400 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510451.910453:0:8183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.910462:0:8183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.910473:0:8183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.910493:0:8183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008341bfda/0x3e734462ed65ad7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510451.910766:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852651392:12345-192.168.201.4@tcp:1:lfs.0 Request processed in 11268us (11485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510451.910775:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 36 00000100:00100000:0.0:1788510451.917270:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510451.917441:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852651904 00000100:00100000:2.0:1788510451.917451:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852651904 00000100:00100000:2.0:1788510451.917712:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 26 00000100:00100000:2.0:1788510451.917726:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+38:10507:x1875388852651904:12345-192.168.201.4@tcp:35:lfs.0 00000004:00010000:2.0:1788510451.917792:0:5824:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65ac9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73359 expref: 38 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788510451.918081:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788510451.918120:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788510451.918450:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788510451.918779:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.918795:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65a83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73336 expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.918804:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.918849:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73336 expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.918866:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65a83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73336 expref: 42 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510451.918878:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ec380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5824:1875388861059328:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510451.918965:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788510451.927356:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.927433:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852652032 00000100:00100000:1.0:1788510451.927444:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852652032 00010000:00010000:1.0:1788510451.927496:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65a83 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73336 expref: 43 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510451.927544:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 51 00000100:00100000:1.0:1788510451.927553:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+43:2340:x1875388852652032:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510451.927568:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510451.927575:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65a83 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73336 expref: 43 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.927588:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65a83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73336 expref: 43 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.927610:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92000) 00010000:00010000:1.0:1788510451.927615:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.927625:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.927633:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.927652:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510451.927707:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+43:2340:x1875388852652032:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 154us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510451.927714:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 51 00010000:00010000:3.0:1788510451.928876:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65a83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73336 expref: 42 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510451.928901:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ec380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5824:1875388861059328:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510451.928923:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.928933:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510451.928939:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788510451.929756:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788510451.929969:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788510451.930823:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88311c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1875388861059456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788510451.930905:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510451.930945:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a877b80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510451.931005:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861059456 00000100:00100000:2.0:1788510451.931012:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861059456 00000100:00100000:2.0:1788510451.931075:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788510451.931084:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1875388861059456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788510451.931192:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1875388861059456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510451.931207:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788510451.931519:0:5824:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788510451.931536:0:5824:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788510451.931556:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff929aaed50380, transno 4294967301 00000100:00100000:0.0:1788510451.931601:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88311c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1875388861059456:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788510451.932084:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788510451.932153:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae943b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1875388861059584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788510451.932193:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510451.932252:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b33900 going to sleep for 11 seconds 00000100:00100000:2.0:1788510451.932509:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861059584 00000100:00100000:2.0:1788510451.932515:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861059584 00000100:00100000:2.0:1788510451.932572:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788510451.932580:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1875388861059584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788510451.932766:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5824:x1875388861059584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 186us (570us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788510451.932775:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788510451.932815:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae943b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1875388861059584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788510451.932885:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788510451.932924:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.932935:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.932943:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.932949:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510451.932954:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.932961:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.932977:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92000) 00010000:00010000:2.0:1788510451.932980:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788510451.932993:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510451.933000:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65ade lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788510451.933190:0:5824:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788510451.933316:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788510451.933326:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309752102977ns, next at 310752101167ns, rc = 0 00000001:00080000:2.0:1788510451.933332:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788510451.933359:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92000) 00010000:00010000:2.0:1788510451.933362:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788510451.933369:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65ac9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73359 expref: 46 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510451.933459:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+45:10507:x1875388852651904:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 15737us (16198us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788510451.933466:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 26 00000020:00080000:2.0:1788510451.933470:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788510451.938102:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.938192:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852652160 00000100:00100000:1.0:1788510451.938214:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852652160 00000100:00100000:1.0:1788510451.938303:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 100 00000100:00100000:1.0:1788510451.938312:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+45:10507:x1875388852652160:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510451.938334:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510451.938358:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65ae5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73360 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.938422:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65ae5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73360 expref: 46 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.938437:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65ae5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73360 expref: 46 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510451.938466:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:1.0:1788510451.938469:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788510451.938473:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033400, rc 0) 00000100:00100000:1.0:1788510451.938542:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+46:10507:x1875388852652160:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 231us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510451.938549:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 100 00000100:00100000:2.0:1788510451.943153:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510451.943352:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852652416 00000100:00100000:1.0:1788510451.943361:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852652416 00000100:00100000:1.0:1788510451.943417:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 27 00000100:00100000:1.0:1788510451.943426:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+46:10507:x1875388852652416:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:1.0:1788510451.943833:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+47:10507:x1875388852652416:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 406us (700us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788510451.943851:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 27 00010000:00010000:0.0:1788510451.974727:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510452.026889:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510452.026988:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852652544 00000100:00100000:1.0:1788510452.027011:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852652544 00000100:00100000:1.0:1788510452.027069:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 101 00000100:00100000:1.0:1788510452.027078:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+47:10517:x1875388852652544:12345-192.168.201.4@tcp:34:lfs.0 00010000:00010000:1.0:1788510452.027172:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65aec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027190:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65aec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027201:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65aec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027217:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65af3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027252:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027259:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027344:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65afa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027352:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027358:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788510452.027395:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027417:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65aec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027423:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65aec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027429:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027435:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510452.027440:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027447:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65aec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027470:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:1.0:1788510452.027473:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510452.027478:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65aec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027485:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65aec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027497:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027503:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65af3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027508:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65af3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027519:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510452.027521:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65af3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027727:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65af3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027736:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a82b92300) 00010000:00010000:1.0:1788510452.027739:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510452.027742:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65af3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027748:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65af3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027764:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027769:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65afa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027774:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027780:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510452.027782:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027788:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65afa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027804:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:1.0:1788510452.027807:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510452.027810:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65afa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.027816:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65afa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510452.027947:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+47:10517:x1875388852652544:12345-192.168.201.4@tcp:34:lfs.0 Request processed in 868us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510452.027955:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 101 00000100:00100000:3.0:1788510452.068623:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510452.069303:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852652800 00000100:00100000:1.0:1788510452.069318:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852652800 00000100:00100000:1.0:1788510452.069423:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 102 00000100:00100000:1.0:1788510452.069434:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+47:10520:x1875388852652800:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510452.069463:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510452.069490:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65b01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73367 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069629:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65b08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069644:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069655:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069670:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65b0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069691:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069699:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069826:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069844:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069852:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510452.069862:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788510452.069969:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069977:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65b08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069985:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65b08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.069991:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510452.069998:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65b08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070005:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65b08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070028:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:1.0:1788510452.070031:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510452.070036:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65b08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070042:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65b08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070057:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070063:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65b0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070069:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070075:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510452.070077:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070083:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65b0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070090:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929a82b92300) 00010000:00010000:1.0:1788510452.070092:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510452.070094:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65b0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070099:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65b0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070163:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65b01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73367 expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070178:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73367 expref: 49 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.070186:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:1.0:1788510452.070188:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788510452.070190:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032000, rc 0) 00000100:00100000:1.0:1788510452.070358:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+49:10520:x1875388852652800:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 926us (1751us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788510452.070366:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 102 00000100:00100000:2.0:1788510452.073081:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510452.073670:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852652928 00000100:00100000:1.0:1788510452.073680:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852652928 00000100:00100000:1.0:1788510452.073739:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 103 00000100:00100000:1.0:1788510452.073750:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+49:10520:x1875388852652928:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:1.0:1788510452.073812:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65b24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.073828:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.073849:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.073882:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.073904:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65b24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.073911:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.073918:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510452.073922:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.073930:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.073942:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:1.0:1788510452.073945:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788510452.073949:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65b24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.073955:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65b24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510452.074021:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+49:10520:x1875388852652928:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 272us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510452.074028:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 103 00000100:00100000:2.0:1788510452.076672:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510452.076755:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852653184 00000100:00100000:1.0:1788510452.076766:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852653184 00000100:00100000:1.0:1788510452.076831:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 28 00000100:00100000:1.0:1788510452.076851:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+49:10520:x1875388852653184:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:1.0:1788510452.077123:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+50:10520:x1875388852653184:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 274us (464us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788510452.077149:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 28 00000100:00100000:0.0:1788510452.171609:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510452.171891:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852653440 00000100:00100000:3.0:1788510452.171918:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852653440 00000100:00100000:3.0:1788510452.171989:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 104 00000100:00100000:3.0:1788510452.172001:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+50:10530:x1875388852653440:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:3.0:1788510452.172025:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510452.172029:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788510452.172058:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65aa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7334b expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.172079:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:3.0:1788510452.172085:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788510452.172099:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65b2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7336e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.172200:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.172213:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65b16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73367 expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.172266:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.172299:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73367 expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.172313:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65b16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73367 expref: 50 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510452.172328:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88311f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861059712:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510452.172429:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a877b8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510452.177907:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510452.177991:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852653568 00000100:00100000:0.0:1788510452.178000:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852653568 00010000:00010000:0.0:1788510452.178043:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65b16 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73367 expref: 51 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510452.178091:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 52 00000100:00100000:0.0:1788510452.178100:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+51:2340:x1875388852653568:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510452.178118:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510452.178124:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65b16 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73367 expref: 51 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510452.178137:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65b16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73367 expref: 51 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510452.178172:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:0.0:1788510452.178177:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510452.178187:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510452.178195:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510452.178253:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510452.178308:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+51:2340:x1875388852653568:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 208us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510452.178316:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 52 00010000:00010000:2.0:1788510452.179211:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed65b16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73367 expref: 50 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510452.179258:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88311f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861059712:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510452.179288:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.179312:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.179319:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510452.179337:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788510452.179494:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65b2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7336e expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.179509:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7336e expref: 50 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.179517:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:2.0:1788510452.179527:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788510452.179530:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68e00, rc 0) 00000100:00100000:2.0:1788510452.179848:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+50:10530:x1875388852653440:12345-192.168.201.4@tcp:101:bash.0 Request processed in 7849us (8248us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788510452.179856:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 104 00000100:00100000:3.0:1788510452.183031:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510452.183554:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852653824 00000100:00100000:2.0:1788510452.183760:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852653824 00000100:00100000:2.0:1788510452.183855:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 105 00000100:00100000:2.0:1788510452.183867:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+50:10530:x1875388852653824:12345-192.168.201.4@tcp:36:bash.0 00010000:00010000:2.0:1788510452.184498:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.184516:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.184961:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788510452.185028:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788510452.185353:0:9544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdb0f808 reply state 00000000649e2158 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510452.185364:0:9544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788510452.185773:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+53:10530:x1875388852653824:12345-192.168.201.4@tcp:36:bash.0 Request processed in 1904us (2749us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788510452.185782:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 105 00000020:00080000:2.0:1788510452.185788:0:9544:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788510452.190896:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00010000:00010000:1.0:1788510452.190972:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.190985:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.190993:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.190999:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510452.191004:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.191012:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.191029:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:1.0:1788510452.191032:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510452.191038:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.191045:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510452.191141:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852653952 00000100:00100000:2.0:1788510452.191152:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852653952 00000100:00100000:2.0:1788510452.191208:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 106 00000100:00100000:2.0:1788510452.191219:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+52:10530:x1875388852653952:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510452.191262:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510452.191279:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65b47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73375 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.191363:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.191377:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7336e expref: 53 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.191386:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.191427:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7336e expref: 53 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.191440:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7336e expref: 53 pid: 5822 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510452.191460:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed50700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861059840:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510452.192584:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788510452.196550:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed50700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861059840:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510452.196787:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510452.202466:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510452.202583:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852654080 00000100:00100000:2.0:1788510452.202595:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852654080 00010000:00010000:2.0:1788510452.202655:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7336e expref: 54 pid: 5822 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510452.202703:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 53 00000100:00100000:2.0:1788510452.202714:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:2340:x1875388852654080:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510452.202731:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510452.202739:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7336e expref: 54 pid: 5822 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.202752:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7336e expref: 54 pid: 5822 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.202794:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65b32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7336e expref: 54 pid: 5822 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.202813:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:2.0:1788510452.202818:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.202829:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.202849:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.202884:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510452.202962:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+53:2340:x1875388852654080:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 249us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510452.202970:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 53 00010000:00010000:1.0:1788510452.203486:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.203497:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510452.203664:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788510452.203670:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510452.203692:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.203726:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65b47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73375 expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.203745:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73375 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.203753:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:1.0:1788510452.203756:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788510452.203759:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77c00, rc 0) 00000100:00100000:1.0:1788510452.203796:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+52:10530:x1875388852653952:12345-192.168.201.4@tcp:101:bash.0 Request processed in 12580us (12911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510452.203804:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 106 00000100:00100000:3.0:1788510452.211942:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510452.213711:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852654336 00000100:00100000:1.0:1788510452.213728:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852654336 00000100:00100000:0.0:1788510452.213937:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 29 00000100:00100000:0.0:1788510452.213951:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+52:10530:x1875388852654336:12345-192.168.201.4@tcp:35:bash.0 00000100:00100000:0.0:1788510452.214516:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+53:10530:x1875388852654336:12345-192.168.201.4@tcp:35:bash.0 Request processed in 567us (2587us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788510452.214532:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 29 00000100:00100000:3.0:1788510452.295120:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510452.295280:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852654464 00000100:00100000:2.0:1788510452.295290:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852654464 00000100:00100000:2.0:1788510452.295358:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 107 00000100:00100000:2.0:1788510452.295368:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+53:10536:x1875388852654464:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510452.295392:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510452.295415:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65b55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7337c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.295496:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.295712:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.295724:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510452.295758:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788510452.295762:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510452.295779:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.295805:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65b55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7337c expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.295824:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7337c expref: 54 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.295844:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:2.0:1788510452.295848:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510452.295851:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77800, rc 0) 00000100:00100000:2.0:1788510452.295917:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:10536:x1875388852654464:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 550us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510452.295925:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 107 00000100:00100000:1.0:1788510452.300582:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510452.300650:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852654592 00000100:00100000:2.0:1788510452.300660:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852654592 00000100:00100000:2.0:1788510452.300717:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 108 00000100:00100000:2.0:1788510452.300728:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:10536:x1875388852654592:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510452.300748:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510452.300782:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65b63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73383 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.300854:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.300870:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.300881:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.300895:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.300902:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.300907:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.300992:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65b78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301001:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301007:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510452.301040:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788510452.301044:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510452.301073:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301093:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301102:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301109:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301115:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301121:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510452.301125:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301132:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301145:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:2.0:1788510452.301149:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510452.301154:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301161:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301176:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301181:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301196:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301201:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510452.301203:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301209:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301216:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929aac578a00) 00010000:00010000:2.0:1788510452.301218:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510452.301250:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301258:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301286:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65b63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73383 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301298:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73383 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.301304:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:2.0:1788510452.301307:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510452.301310:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76600, rc 0) 00000100:00100000:2.0:1788510452.301368:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:10536:x1875388852654592:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 642us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510452.301383:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 108 00000100:00100000:3.0:1788510452.309958:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510452.310015:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510452.310131:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852654720 00000100:00100000:1.0:1788510452.310152:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852654720 00000100:00100000:1.0:1788510452.310256:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:1.0:1788510452.310267:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:2340:x1875388852654720:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510452.310288:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510452.310319:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65b78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73383 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510452.310359:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:1.0:1788510452.310365:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510452.310424:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:2340:x1875388852654720:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 159us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510452.310432:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:2.0:1788510452.312019:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852654976 00000100:00100000:2.0:1788510452.312037:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852654976 00000100:00100000:2.0:1788510452.312359:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 109 00000100:00100000:2.0:1788510452.312370:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:10536:x1875388852654976:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510452.312391:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510452.312410:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65b7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7338a expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.312703:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.312718:0:9544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73375 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.312727:0:9544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.312760:0:9544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73375 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.312773:0:9544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73375 expref: 55 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510452.312786:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed50700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861059968:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510452.312902:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788510452.318355:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510452.318420:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852655104 00000100:00100000:0.0:1788510452.318429:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852655104 00010000:00010000:0.0:1788510452.318484:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73375 expref: 56 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510452.318527:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 54 00000100:00100000:0.0:1788510452.318536:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:2341:x1875388852655104:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510452.318549:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510452.318555:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73375 expref: 56 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510452.318568:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73375 expref: 56 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510452.318590:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:0.0:1788510452.318595:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510452.318618:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510452.318626:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510452.318645:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510452.318698:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:2341:x1875388852655104:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 162us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510452.318704:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 54 00010000:00010000:2.0:1788510452.320360:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73375 expref: 55 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510452.320397:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed50700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861059968:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510452.320418:0:9544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.320427:0:9544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.320433:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510452.320602:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788510452.320769:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65b7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7338a expref: 56 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.320786:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7338a expref: 55 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.320795:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:2.0:1788510452.320798:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788510452.320801:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77200, rc 0) 00000100:00100000:2.0:1788510452.320922:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:10536:x1875388852654976:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 8554us (10906us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788510452.320931:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 109 00000100:00100000:1.0:1788510452.325002:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510452.325165:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852655360 00000100:00100000:0.0:1788510452.325179:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852655360 00000100:00100000:0.0:1788510452.325665:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:0.0:1788510452.325676:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:10536:x1875388852655360:12345-192.168.201.4@tcp:103:lfs.0 00010000:00010000:0.0:1788510452.325692:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510452.325715:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65ae5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73360 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510452.325733:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:0.0:1788510452.325738:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510452.325795:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:10536:x1875388852655360:12345-192.168.201.4@tcp:103:lfs.0 Request processed in 121us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510452.325803:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:0.0:1788510452.329155:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510452.329273:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852655488 00000100:00100000:2.0:1788510452.329285:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852655488 00000100:00100000:2.0:1788510452.329356:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 110 00000100:00100000:2.0:1788510452.329369:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:10536:x1875388852655488:12345-192.168.201.4@tcp:58:lfs.0 00010000:00010000:2.0:1788510452.329507:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.329534:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510452.329548:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788510452.329760:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788510452.329862:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:10536:x1875388852655488:12345-192.168.201.4@tcp:58:lfs.0 Request processed in 494us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510452.329870:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 110 00000100:00100000:0.0:1788510452.333583:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510452.334732:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852655616 00000100:00100000:3.0:1788510452.334748:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852655616 00000100:00100000:3.0:1788510452.334827:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 111 00000100:00100000:3.0:1788510452.334847:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:10536:x1875388852655616:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:3.0:1788510452.334866:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510452.334886:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73391 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.334954:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.334965:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65b9b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73391 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.334986:0:5821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.335001:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65b9b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73391 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.335015:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:3.0:1788510452.335033:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788510452.335038:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65b9b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73391 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510452.335059:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69400, rc 0) 00000100:00100000:3.0:1788510452.335139:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:10536:x1875388852655616:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 293us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510452.335157:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 111 00010000:00010000:3.0:1788510452.998554:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788510453.124511:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510453.124523:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510453.124583:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788510453.124589:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788510453.124743:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88948700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861060096:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788510453.124873:0:11661:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a877b8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510453.127396:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88948700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861060096:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788510453.128751:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.131907:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852655744 00000100:00100000:2.0:1788510453.132079:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852655744 00000100:00100000:2.0:1788510453.132176:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 112 00000100:00100000:2.0:1788510453.132187:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:10537:x1875388852655744:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788510453.132219:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788510453.132342:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:10537:x1875388852655744:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 157us (3599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510453.132350:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 112 00000100:00080000:1.0:1788510453.132476:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510453.148682:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510453.148781:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852655872 00000100:00100000:3.0:1788510453.148791:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852655872 00000100:00100000:3.0:1788510453.148859:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 113 00000100:00100000:3.0:1788510453.148869:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:10537:x1875388852655872:12345-192.168.201.4@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788510453.148945:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65ba2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.149214:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.149251:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.149317:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65ba9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.149327:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.149335:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.149358:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.149365:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.149371:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510453.149407:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788510453.149412:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510453.149439:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.149450:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153591:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153601:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153630:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510453.153636:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153646:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65ba2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153664:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:3.0:1788510453.153667:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510453.153673:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65ba2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153681:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65ba2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153702:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153709:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153715:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153720:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510453.153723:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153729:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153748:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff929a83eab200) 00010000:00010000:3.0:1788510453.153751:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510453.153754:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65ba9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153760:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65ba9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153780:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153786:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153791:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153796:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510453.153798:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153804:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153831:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:3.0:1788510453.153834:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510453.153837:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.153843:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510453.153983:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:10537:x1875388852655872:12345-192.168.201.4@tcp:34:lhsmtool_posix.0 Request processed in 5109us (5305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510453.153993:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 113 00000100:00100000:0.0:1788510453.159706:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.159806:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852656128 00000100:00100000:2.0:1788510453.159826:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852656128 00000100:00100000:2.0:1788510453.159883:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 114 00000100:00100000:2.0:1788510453.159893:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:10537:x1875388852656128:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788510453.159921:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510453.159942:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bb7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73398 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160336:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160354:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160367:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510453.160380:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788510453.160697:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160708:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160715:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160720:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510453.160724:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160732:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160747:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:2.0:1788510453.160751:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788510453.160757:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160778:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160839:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bb7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73398 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160850:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:2.0:1788510453.160852:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788510453.160856:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73398 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.160865:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77000, rc 0) 00000100:00100000:2.0:1788510453.161341:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:10537:x1875388852656128:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 1447us (1645us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788510453.161350:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 114 00000100:00100000:0.0:1788510453.167174:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.167305:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852656256 00000100:00100000:2.0:1788510453.167315:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852656256 00000100:00100000:2.0:1788510453.167387:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 115 00000100:00100000:2.0:1788510453.167397:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:10537:x1875388852656256:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788510453.167438:0:9544:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788510453.167552:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:10537:x1875388852656256:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 155us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510453.167561:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 115 00000100:00100000:0.0:1788510453.171797:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510453.176417:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852656512 00000100:00100000:3.0:1788510453.176434:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852656512 00000100:00100000:3.0:1788510453.176691:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 116 00000100:00100000:3.0:1788510453.176703:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:10537:x1875388852656512:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510453.176726:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510453.176730:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788510453.176758:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7337c expref: 56 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.176780:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:3.0:1788510453.176785:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788510453.176797:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bcc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7339f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788510453.180885:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788510453.183206:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65bd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.183247:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.183261:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.183331:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7339f expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.183370:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7339f expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.183379:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929a83eab200) 00010000:00010000:3.0:1788510453.183382:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510453.183386:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68a00, rc 0) 00000100:00100000:3.0:1788510453.183458:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+57:10537:x1875388852656512:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 6756us (11671us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788510453.183468:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 116 00000100:00100000:0.0:1788510453.192956:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.193400:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852656768 00000100:00100000:2.0:1788510453.193410:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852656768 00000100:00100000:2.0:1788510453.193491:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 117 00000100:00100000:2.0:1788510453.193519:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+57:10537:x1875388852656768:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788510453.193594:0:9544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510453.193625:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65bd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7339f expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193649:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929a83eab200) 00010000:00010000:2.0:1788510453.193660:0:9544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788510453.193689:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65be1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193704:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65be1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193714:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65be1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193740:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65be8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe65c5eb9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193747:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe65c5eb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193753:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe65c5eb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193839:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65be1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193847:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65be1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193855:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65be1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193868:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510453.193873:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65be1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193882:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65be1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193891:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:2.0:1788510453.193894:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510453.193898:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65be1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193903:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65be1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193913:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe65c5eb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193919:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65be8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe65c5eb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193925:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65be8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe65c5eb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193930:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510453.193933:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65be8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe65c5eb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193939:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65be8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe65c5eb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193956:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe65c5eb9 (ffff929aac578a00) 00010000:00010000:2.0:1788510453.193959:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510453.193962:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65be8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe65c5eb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.193968:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65be8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe65c5eb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510453.194052:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:10537:x1875388852656768:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 535us (1106us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788510453.194059:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 117 00000100:00100000:0.0:1788510453.203164:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.203246:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852656896 00000100:00100000:2.0:1788510453.203255:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852656896 00000100:00100000:2.0:1788510453.203320:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 118 00000100:00100000:2.0:1788510453.203330:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:10537:x1875388852656896:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788510453.203348:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510453.203368:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733a6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.203400:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.203411:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.203422:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.203523:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65bef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733a6 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.203549:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733a6 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.203558:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929aac578a00) 00010000:00010000:2.0:1788510453.203561:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788510453.203565:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77000, rc 0) 00000100:00100000:2.0:1788510453.203634:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+57:10537:x1875388852656896:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 305us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510453.203641:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 118 00000100:00100000:0.0:1788510453.206642:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510453.208868:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852657152 00000100:00100000:3.0:1788510453.208886:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852657152 00000100:00100000:3.0:1788510453.208985:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 119 00000100:00100000:3.0:1788510453.208999:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+57:10537:x1875388852657152:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788510453.209116:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.209136:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.209297:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788510453.209758:0:9544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1788510453.209767:0:9544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311028544035ns, next at 312028541999ns, rc = 0 00000004:00010000:3.0:1788510453.209854:0:9544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001932b257 reply state 00000000b7a8bff8 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510453.209880:0:9544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788510453.209978:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+59:10537:x1875388852657152:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 981us (3344us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788510453.209986:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 119 00000100:00100000:0.0:1788510453.212979:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.213054:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852657280 00000100:00100000:2.0:1788510453.213068:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852657280 00000100:00100000:2.0:1788510453.213139:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 120 00000100:00100000:2.0:1788510453.213160:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+59:10537:x1875388852657280:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788510453.213184:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510453.213203:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733ad expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.213291:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ad expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.213309:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ad expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.213331:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929aac578a00) 00010000:00010000:2.0:1788510453.213334:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788510453.213352:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76a00, rc 0) 00000100:00100000:2.0:1788510453.213422:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:10537:x1875388852657280:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 263us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510453.213436:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 120 00010000:00010000:3.0:1788510453.214062:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.214073:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.214080:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.214085:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510453.214090:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.214097:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.214109:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929aac578a00) 00010000:00010000:3.0:1788510453.214112:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788510453.214116:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.214123:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65bfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510453.217009:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510453.217083:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852657408 00000100:00100000:3.0:1788510453.217092:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852657408 00000100:00100000:3.0:1788510453.217174:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 37 00000100:00100000:3.0:1788510453.217184:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852657408:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788510453.217500:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788510453.217846:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2340:x1875388852657408:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 Request processed in 661us (844us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788510453.217855:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 37 00000100:00100000:0.0:1788510453.221169:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.221463:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852657664 00000100:00100000:2.0:1788510453.221476:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852657664 00000100:00100000:2.0:1788510453.221544:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 30 00000100:00100000:2.0:1788510453.221555:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+59:10537:x1875388852657664:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788510453.222089:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:10537:x1875388852657664:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 534us (941us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788510453.222097:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 30 00000100:00100000:0.0:1788510453.225057:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.225127:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852657920 00000100:00100000:2.0:1788510453.225136:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852657920 00000100:00100000:2.0:1788510453.225286:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 121 00000100:00100000:2.0:1788510453.225296:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:10537:x1875388852657920:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788510453.225382:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:10537:x1875388852657920:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510453.225389:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 121 00000100:00100000:0.0:1788510453.227580:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.227845:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852658048 00000100:00100000:2.0:1788510453.227857:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852658048 00000100:00100000:2.0:1788510453.227923:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 122 00000100:00100000:2.0:1788510453.227934:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:10537:x1875388852658048:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788510453.227955:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510453.227974:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733b4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.228090:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65c12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.228105:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.228117:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510453.228461:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510453.228484:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.228515:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733b4 expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.228536:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733b4 expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.228544:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929aac578a00) 00010000:00010000:2.0:1788510453.228546:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788510453.228550:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76400, rc 0) 00000100:00100000:2.0:1788510453.228652:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+61:10537:x1875388852658048:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 719us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510453.228660:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 122 00000100:00100000:0.0:1788510453.231787:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510453.233508:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852658176 00000100:00100000:1.0:1788510453.233522:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852658176 00000100:00100000:1.0:1788510453.233592:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 38 00000100:00100000:1.0:1788510453.233604:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2341:x1875388852658176:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788510453.233621:0:6667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510453.233640:0:6667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed65c19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733bb expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788510453.233664:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a80f5, blocks: 0x1 00010000:00010000:1.0:1788510453.233683:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=311s v=(0 0) 00010000:00010000:1.0:1788510453.233687:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510453.233697:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed65c19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733bb expref: 10 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.233715:0:6667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed65c19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733bb expref: 10 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.233745:0:6667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033000, rc 0) 00000100:00100000:1.0:1788510453.233804:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:2341:x1875388852658176:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 203us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510453.233811:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 38 00000100:00100000:0.0:1788510453.236612:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510453.236659:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852658432 00000100:00100000:3.0:1788510453.236667:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852658432 00000100:00100000:3.0:1788510453.236758:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 123 00000100:00100000:3.0:1788510453.236771:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+61:10537:x1875388852658432:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788510453.236885:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+61:10537:x1875388852658432:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 117us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510453.236890:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 123 00000100:00100000:2.0:1788510453.238475:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510453.238591:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852658560 00000100:00100000:1.0:1788510453.238598:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852658560 00000100:00100000:1.0:1788510453.238696:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 39 00000100:00100000:1.0:1788510453.238704:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:10537:x1875388852658560:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788510453.238717:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510453.238731:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733c2 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.238753:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed65c19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733bb expref: 11 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.238759:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510453.238762:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510453.238766:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 11 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.238789:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed65c19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733bb expref: 11 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.238798:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed65c19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733bb expref: 11 pid: 6667 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510453.238838:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1875388861060224:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510453.238965:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a91b33c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510453.240507:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1875388861060224:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510453.240538:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 11 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.240557:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032400, rc 0) 00000100:00100000:1.0:1788510453.240653:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:10537:x1875388852658560:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 1949us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510453.240662:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 39 00000100:00100000:0.0:1788510453.242082:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510453.242180:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852658688 00000100:00100000:1.0:1788510453.242188:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852658688 00010000:00010000:1.0:1788510453.242244:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed65c19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733bb expref: 11 pid: 6667 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510453.242309:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 55 00000100:00100000:1.0:1788510453.242317:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:2340:x1875388852658688:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510453.242329:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510453.242348:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed65c19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733bb expref: 11 pid: 6667 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.242357:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed65c19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733bb expref: 11 pid: 6667 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.242389:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed65c19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733bb expref: 11 pid: 6667 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.242400:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510453.242403:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510453.242409:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 10 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.242415:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 10 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.242448:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 10 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510453.242459:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1875388861060352:192.168.201.4@tcp:105: 00000100:00100000:1.0:1788510453.242527:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a91b33c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510453.245267:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510453.245327:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852658816 00000100:00100000:0.0:1788510453.245334:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852658816 00002000:00100000:0.0:1788510453.245374:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff929aaed53100 x1875388852658816/t0(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:24/0 lens 504/0 e 0 to 0 dl 1788510464 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788510453.245382:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aaed53100 with x1875388852658816 ext(0->12) 00002000:00010000:0.0:1788510453.245386:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929aaed53100 00000100:00100000:0.0:1788510453.245413:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 2 00000100:00100000:0.0:1788510453.245422:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:2341:x1875388852658816:12345-192.168.201.4@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788510453.245889:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1875388861060352:192.168.201.4@tcp:105: 00010000:00010000:1.0:1788510453.245911:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510453.245968:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2340:x1875388852658688:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 3650us (3891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510453.245968:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2341:x1875388852658816:12345-192.168.201.4@tcp:4:lhsmtool_posix.0 Request processed in 545us (708us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788510453.245976:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 55 00000100:00100000:0.0:1788510453.245976:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 2 00002000:00100000:0.0:1788510453.245983:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff929aaed53100 x1875388852658816/t4294967308(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:24/0 lens 504/448 e 0 to 0 dl 1788510464 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788510453.246001:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aaed53100 with x1875388852658816 ext(0->12) 00002000:00010000:0.0:1788510453.246005:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929aaed53100 00000100:00100000:2.0:1788510453.247841:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510453.248889:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852658944 00000100:00100000:1.0:1788510453.248900:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852658944 00000100:00100000:1.0:1788510453.248965:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 124 00000100:00100000:1.0:1788510453.248975:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+61:10537:x1875388852658944:12345-192.168.201.4@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788510453.280548:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967395 is committed 00000020:00080000:0.0:1788510453.280567:0:5843:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff929a88b33d80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788510453.280572:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929a982e1600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff929a88b333c0 00000020:00080000:0.0:1788510453.280575:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929ab4a11100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff929aaef5d800 00000004:00080000:0.0:1788510453.280598:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1788510453.280645:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788510453.280661:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788510453.280685:0:5843:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff929a91f2f900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788510453.280688:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929a88c84e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff929a91f2f840 00000020:00080000:0.0:1788510453.280691:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929a88c84400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff929a90ee1400 00000004:00080000:0.0:1788510453.280698:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788510453.280808:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788510453.281002:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788510453.281168:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788510453.281401:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:10537:x1875388852658944:12345-192.168.201.4@tcp:44:lhsmtool_posix.0 Request processed in 32421us (33564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510453.281411:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 124 00000100:00100000:3.0:1788510453.283808:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510453.283934:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852659072 00000100:00100000:1.0:1788510453.283946:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852659072 00000100:00100000:1.0:1788510453.284006:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 40 00000100:00100000:1.0:1788510453.284017:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+12:2340:x1875388852659072:12345-192.168.201.4@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788510453.286608:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861060608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788510453.286689:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510453.286729:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861060480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788510453.286750:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510453.286786:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861060608 00000100:00100000:0.0:1788510453.286793:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861060608 00000100:00100000:0.0:1788510453.286853:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861060480 00000100:00100000:0.0:1788510453.286856:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861060480 00000100:00100000:0.0:1788510453.286872:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788510453.286880:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861060608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788510453.287086:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788510453.287097:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788510453 00002000:00010000:0.0:1788510453.287100:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788510453.287102:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788510453 -> 1788510453 00002000:00010000:0.0:1788510453.287104:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788510453.287143:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3291:x1875388861060608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 263us (454us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788510453.287150:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788510453.287169:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788510453.287175:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861060480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788510453.287190:0:6669:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788510453.287209:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.287245:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed659e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73321 expref: 12 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.287255:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1788510453.287259:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788510453.287264:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.287294:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed659e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73321 expref: 12 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.287310:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed659e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73321 expref: 12 pid: 6669 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510453.287336:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1875388861060736:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510453.287397:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b339c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788510453.287411:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788510453.287843:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861060864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788510453.287875:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788510453.288124:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929aaf0df480/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788510453.288132:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861060608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788510453.288621:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788510453.288630:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788510453.288661:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788510453.288667:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861060864 00000100:00100000:3.0:1788510453.288674:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861060864 00000100:00080000:0.0:1788510453.289447:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788510453.291134:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788510453.291151:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3288:x1875388861060864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788510453.291185:0:12047:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1788510453.291218:0:12047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9a80f3, atime: 0x6a9a80f3, ctime: 0x6a9a80f3, blocks: 0x1 00010000:00010000:3.0:1788510453.291267:0:12047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3bbde5b/0x3e734462ed65c2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.291293:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=311s v=(0 0) 00010000:00010000:3.0:1788510453.291298:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788510453.291307:0:12047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3bbde5b/0x3e734462ed65c2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.291326:0:12047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3bbde5b/0x3e734462ed65c2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.291337:0:12047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3bbde5b/0x3e734462ed65c2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.291345:0:12047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3bbde5b/0x3e734462ed65c2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.291364:0:12047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788510453.291931:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3288:x1875388861060864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 785us (4055us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788510453.291941:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1788510453.291981:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510453.291987:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3bbde5b/0x3e734462ed65c2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.291996:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510453.292001:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3bbde5b/0x3e734462ed65c2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.292023:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3bbde5b/0x3e734462ed65c2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.292039:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3bbde5b/0x3e734462ed65c2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.292047:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3bbde5b/0x3e734462ed65c2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.292063:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510453.292065:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510453.292067:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788510453.292156:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929aaf0df800/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788510453.292164:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861060864:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788510453.293872:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1875388861060736:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510453.293905:0:6669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510453.294595:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.294843:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852659200 00000100:00100000:2.0:1788510453.294851:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852659200 00010000:00010000:2.0:1788510453.294894:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed659e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73321 expref: 13 pid: 6669 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510453.294940:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 56 00000100:00100000:2.0:1788510453.294953:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2341:x1875388852659200:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510453.294969:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510453.294975:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed659e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73321 expref: 13 pid: 6669 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.294987:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed659e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73321 expref: 13 pid: 6669 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295011:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed659e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73321 expref: 13 pid: 6669 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295031:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788510453.295035:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788510453.295042:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295070:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295097:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510453.295151:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+12:2341:x1875388852659200:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 200us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510453.295159:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 56 00010000:00010000:2.0:1788510453.295295:0:6669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295306:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295316:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295324:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295339:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788510453.295901:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3291:x1875388861060480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8724us (9147us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788510453.295910:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1788510453.295934:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510453.295941:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295956:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafe00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510453.295960:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295969:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295984:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.295990:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000451f670/0x3e734462ed65c27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.296008:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510453.296010:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510453.296012:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788510453.296050:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929aaf0de300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788510453.296057:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861060480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788510453.320047:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:2340:x1875388852659072:12345-192.168.201.4@tcp:16:lhsmtool_posix.0 Request processed in 36013us (36232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510453.320066:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 40 00000001:00080000:0.0:1788510453.320169:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1788510453.320195:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1788510453.322533:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.322632:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852659456 00000100:00100000:2.0:1788510453.322644:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852659456 00000100:00100000:2.0:1788510453.322707:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 125 00000100:00100000:2.0:1788510453.322717:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:10537:x1875388852659456:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788510453.322781:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510453.322810:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65c12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733b4 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.322863:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929aac578a00) 00010000:00010000:2.0:1788510453.322868:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788510453.322910:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65c35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.322926:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.322936:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788510453.323488:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c13a42e9 reply state 00000000bc8d07c7 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510453.323500:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788510453.323608:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:10537:x1875388852659456:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 891us (1084us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788510453.323617:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 125 00010000:00010000:1.0:1788510453.325015:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65c35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.325029:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65c35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.325035:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65c35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.325041:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510453.325045:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65c35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.325052:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65c35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.325066:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929aac578a00) 00010000:00010000:1.0:1788510453.325069:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510453.325073:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65c35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.325079:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65c35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510453.326478:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510453.326730:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852659584 00000100:00100000:0.0:1788510453.326749:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852659584 00000100:00100000:0.0:1788510453.326836:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 44 00000100:00100000:0.0:1788510453.326847:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852659584:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788510453.327059:0:6667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788510453.327063:0:6667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788510453 -> 1788510452 00002000:00010000:0.0:1788510453.327065:0:6667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788510451 00002000:00010000:0.0:1788510453.327068:0:6667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788510453 -> 1788510452 00002000:00010000:0.0:1788510453.327070:0:6667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788510453.327172:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852659584:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 Request processed in 325us (704us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788510453.327181:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 44 00000100:00100000:2.0:1788510453.330918:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510453.331038:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852659840 00000100:00100000:3.0:1788510453.331049:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852659840 00000100:00100000:3.0:1788510453.331140:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 126 00000100:00100000:3.0:1788510453.331175:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:10537:x1875388852659840:12345-192.168.201.4@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788510453.331694:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.331721:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733a6 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.331733:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.331776:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733a6 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.331798:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733a6 expref: 15 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510453.331824:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861060992:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510453.331962:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510453.334117:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510453.334412:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852659968 00000100:00100000:1.0:1788510453.334441:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852659968 00010000:00010000:1.0:1788510453.334485:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bf6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733a6 expref: 16 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510453.334517:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 57 00000100:00100000:1.0:1788510453.334525:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:2341:x1875388852659968:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510453.334540:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510453.334546:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bf6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733a6 expref: 16 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.334559:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733a6 expref: 16 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.334582:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929aac578a00) 00010000:00010000:1.0:1788510453.334587:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.334596:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.334604:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.334623:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510453.334662:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:2341:x1875388852659968:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 137us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510453.334669:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 57 00010000:00010000:3.0:1788510453.335552:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65bf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733a6 expref: 15 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510453.335571:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861060992:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510453.335590:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.335599:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.335604:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.335632:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.335640:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.335647:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.335652:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510453.335656:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.335663:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.335675:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929aac578a00) 00010000:00010000:3.0:1788510453.335688:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788510453.335693:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.335699:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65c3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510453.335766:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:10537:x1875388852659840:12345-192.168.201.4@tcp:55:lhsmtool_posix.0 Request processed in 4593us (4861us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788510453.335774:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 126 00000100:00100000:2.0:1788510453.338657:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510453.338750:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852660096 00000100:00100000:3.0:1788510453.338760:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852660096 00000100:00100000:3.0:1788510453.338871:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 45 00000100:00100000:3.0:1788510453.338883:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2343:x1875388852660096:12345-192.168.201.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788510453.338936:0:12047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.338959:0:12047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.338968:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788510453.338972:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788510453.338977:0:12047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.339013:0:12047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.339046:0:12047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 7 pid: 6669 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510453.339060:0:12047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88949500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12047:1875388861061120:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510453.339158:0:12047:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a877b80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510453.342126:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510453.342255:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852660224 00000100:00100000:0.0:1788510453.342264:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852660224 00010000:00010000:0.0:1788510453.342306:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 8 pid: 6669 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510453.342363:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 58 00000100:00100000:0.0:1788510453.342373:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2341:x1875388852660224:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510453.342391:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510453.342414:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 8 pid: 6669 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.342436:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 8 pid: 6669 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.342474:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788510453.342478:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788510453.342485:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.342495:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.342516:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510453.342575:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2341:x1875388852660224:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 204us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510453.342582:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 58 00010000:00010000:1.0:1788510453.343842:0:12047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed65c20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c2 expref: 7 pid: 6669 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510453.343882:0:12047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88949500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12047:1875388861061120:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510453.343906:0:12047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.343917:0:12047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.343924:0:12047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.343956:0:12047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.343964:0:12047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.343971:0:12047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.343979:0:12047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510453.343984:0:12047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.343993:0:12047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.344017:0:12047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.344024:0:12047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3bbde5b/0x3e734462ed65c43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510453.344101:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2343:x1875388852660096:12345-192.168.201.4@tcp:1:lhsmtool_posix.0 Request processed in 5220us (5455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510453.344110:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 45 00000100:00100000:3.0:1788510453.347003:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510453.347088:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852660480 00000100:00100000:0.0:1788510453.347098:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852660480 00000100:00100000:0.0:1788510453.347161:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 127 00000100:00100000:0.0:1788510453.347172:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:10537:x1875388852660480:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788510453.347298:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65c4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.347315:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65c4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.347327:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65c4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.347558:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.347570:0:9544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ad expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.347577:0:9544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.347608:0:9544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ad expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.347622:0:9544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ad expref: 15 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510453.347636:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861061248:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510453.347716:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b33780 going to sleep for 11 seconds 00000100:00100000:3.0:1788510453.350394:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861061248:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510453.350423:0:9544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510453.352263:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.352687:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852660608 00000100:00100000:2.0:1788510453.352696:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852660608 00010000:00010000:2.0:1788510453.352734:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ad expref: 16 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510453.352766:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 59 00000100:00100000:2.0:1788510453.352775:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:2341:x1875388852660608:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510453.352790:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510453.352796:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ad expref: 16 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.352809:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ad expref: 16 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.352843:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ad expref: 16 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.352857:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929aac578a00) 00010000:00010000:2.0:1788510453.352875:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.352885:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.352893:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.352919:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510453.352978:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:2341:x1875388852660608:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 203us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510453.352985:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 59 00010000:00010000:3.0:1788510453.353821:0:9544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.353832:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788510453.354013:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788510453.354172:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788510453.354219:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788510453.354380:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8894a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9544:1875388861061376:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788510453.354435:0:9544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510453.354678:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a877b80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510453.354745:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861061376 00000100:00100000:2.0:1788510453.354752:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861061376 00000100:00100000:2.0:1788510453.354797:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788510453.354805:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9544:x1875388861061376:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788510453.354904:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9544:x1875388861061376:12345-0@lo:1000:mdt00_003.0 Request processed in 99us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510453.354911:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788510453.355208:0:9544:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788510453.355214:0:9544:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1788510453.355270:0:9544:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff929aaf0df480 x1875388861060608/t4294967309(4294967309) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788510469 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510453.355282:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8894a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9544:1875388861061376:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788510453.355955:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788510453.356013:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9544:1875388861061504:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788510453.356050:0:9544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510453.356077:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788510453.356136:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861061504 00000100:00100000:0.0:1788510453.356141:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861061504 00000100:00100000:0.0:1788510453.356180:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788510453.356187:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9544:x1875388861061504:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788510453.356363:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:9544:x1875388861061504:12345-0@lo:1000:mdt00_003.0 Request processed in 177us (312us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788510453.356371:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788510453.356573:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9544:1875388861061504:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788510453.356602:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356612:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356625:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356631:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510453.356637:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356645:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356662:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929aac578a00) 00010000:00010000:2.0:1788510453.356665:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788510453.356671:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356677:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65c51 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356711:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356718:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356723:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356728:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510453.356731:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356748:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356758:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:2.0:1788510453.356760:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788510453.356768:0:9544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73391 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356779:0:9544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65b9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73391 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356787:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65b9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73391 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.356826:0:9544:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65b9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73391 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510453.356840:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861061632:192.168.201.4@tcp:105: 00000100:00100000:2.0:1788510453.356918:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788510453.360341:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861061632:192.168.201.4@tcp:105: 00010000:00010000:2.0:1788510453.360371:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360383:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65b94 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360415:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360459:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360472:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360483:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360490:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c58 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360496:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360502:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510453.360506:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360513:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c58 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360525:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:2.0:1788510453.360528:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510453.360533:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c58 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360539:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c58 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360548:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65c4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360560:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65c4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360565:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65c4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360570:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510453.360573:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65c4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360578:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65c4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360586:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:2.0:1788510453.360589:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788510453.360592:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65c4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.360597:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65c4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510453.360897:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:10537:x1875388852660480:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 13725us (13901us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788510453.360908:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 127 00000020:00080000:2.0:1788510453.360915:0:9544:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788510453.362008:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510453.362016:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510453.362776:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788510453.362791:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788510453.363700:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510453.364431:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852660736 00000100:00100000:3.0:1788510453.364459:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852660736 00000100:00100000:3.0:1788510453.364549:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 31 00000100:00100000:3.0:1788510453.364561:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:10536:x1875388852660736:12345-192.168.201.4@tcp:49:lfs.0 00000100:00100000:3.0:1788510453.364720:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:10536:x1875388852660736:12345-192.168.201.4@tcp:49:lfs.0 Request processed in 160us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510453.364729:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 31 00000100:00100000:3.0:1788510453.368900:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.368978:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852660992 00000100:00100000:2.0:1788510453.368989:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852660992 00000100:00100000:2.0:1788510453.369047:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 32 00000100:00100000:2.0:1788510453.369057:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:10537:x1875388852660992:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788510453.369796:0:5824:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788510453.369930:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788510453.369979:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.369998:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.370012:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.370021:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c5f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.370027:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c5f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.370032:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.370054:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788510453.370168:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:10537:x1875388852660992:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 1110us (1278us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788510453.370178:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 32 00000020:00080000:2.0:1788510453.370183:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788510453.370808:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510453.370827:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.370836:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76a00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:0.0:1788510453.370845:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.370855:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.370868:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff929aac578f00) 00010000:00010000:0.0:1788510453.370871:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788510453.370876:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c5f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.370883:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510453.370903:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510453.370905:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510453.370906:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510453.374358:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510453.374591:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852661248 00000100:00100000:3.0:1788510453.374605:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852661248 00000100:00100000:3.0:1788510453.374676:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 128 00000100:00100000:3.0:1788510453.374688:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:10536:x1875388852661248:12345-192.168.201.4@tcp:58:lfs.0 00000040:00080000:3.0:1788510453.374961:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788510453.375046:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:10536:x1875388852661248:12345-192.168.201.4@tcp:58:lfs.0 Request processed in 359us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510453.375053:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 128 00000100:00100000:1.0:1788510453.404337:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.404440:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852661376 00000100:00100000:2.0:1788510453.404459:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852661376 00000100:00100000:2.0:1788510453.404513:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 129 00000100:00100000:2.0:1788510453.404523:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:10539:x1875388852661376:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510453.404546:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510453.404582:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733c9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.404648:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65c6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.404663:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65c6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.404676:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65c6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.404691:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65c74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.404698:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.404704:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.405016:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.405027:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7338a expref: 21 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.405036:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.405068:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7338a expref: 21 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510453.405091:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7338a expref: 21 pid: 9544 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510453.405105:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861061760:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510453.405260:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788510453.407928:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861061760:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510453.407961:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510453.408760:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510453.409022:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852661632 00000100:00100000:2.0:1788510453.409030:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852661632 00000100:00100000:2.0:1788510453.409076:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00100000:2.0:1788510453.409085:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:5581:x1875388852661632:12345-192.168.201.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788510453.409403:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:5581:x1875388852661632:12345-192.168.201.4@tcp:35:ldlm_bl.0 Request processed in 318us (648us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788510453.409408:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00100000:0.0:1788510453.410957:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510453.411028:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852661760 00000100:00100000:3.0:1788510453.411036:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852661760 00010000:00010000:3.0:1788510453.411077:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7338a expref: 23 pid: 9544 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510453.411138:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 60 00000100:00100000:3.0:1788510453.411158:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:2341:x1875388852661760:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510453.411173:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510453.411180:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7338a expref: 23 pid: 9544 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.411197:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7338a expref: 23 pid: 9544 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.411219:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65b86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7338a expref: 23 pid: 9544 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.411274:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:3.0:1788510453.411279:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.411288:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.411298:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510453.411331:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510453.411378:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:2341:x1875388852661760:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 232us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510453.411385:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 60 00010000:00010000:1.0:1788510453.411873:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.411885:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510453.411931:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788510453.411937:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510453.411958:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.411970:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.411979:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65c6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.411999:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65c6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412005:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412011:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510453.412015:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412022:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65c6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412032:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:1.0:1788510453.412035:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510453.412039:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65c6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412045:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed65c6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412057:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412062:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65c74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412067:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65c74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412072:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510453.412081:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65c74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412088:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65c74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412096:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff929aac578a00) 00010000:00010000:1.0:1788510453.412099:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510453.412102:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65c74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412107:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed65c74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412141:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65c66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c9 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412167:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c9 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510453.412180:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:1.0:1788510453.412183:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788510453.412185:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76a00, rc 0) 00000100:00100000:1.0:1788510453.412325:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10539:x1875388852661376:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 7803us (7997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510453.412332:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 129 00000100:00100000:1.0:1788510453.444521:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861061888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510453.444609:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510453.444966:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861061888 00000100:00100000:3.0:1788510453.444989:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861061888 00000100:00100000:3.0:1788510453.445061:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788510453.445072:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875388861061888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788510453.445115:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510453.448644:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875388861061888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3559us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510453.448661:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788510453.452857:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861061888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788510454.021531:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788510454.314772:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510454.314784:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510454.322462:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788510454.322472:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788510454.411893:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788510454.411904:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788510454.411957:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788510454.411975:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788510454.412363:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861062016:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788510454.412614:0:11661:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab50543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510454.417881:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510454.418036:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861062016:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788510454.418085:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852661888 00000100:00100000:1.0:1788510454.418096:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852661888 00000100:00100000:1.0:1788510454.418155:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 130 00000100:00100000:1.0:1788510454.418165:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10551:x1875388852661888:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788510454.418200:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788510454.418335:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10551:x1875388852661888:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 170us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510454.418346:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 130 00000100:00100000:3.0:1788510454.426326:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510454.426405:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852662144 00000100:00100000:0.0:1788510454.426416:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852662144 00000100:00100000:0.0:1788510454.426497:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 131 00000100:00100000:0.0:1788510454.426518:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:10551:x1875388852662144:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788510454.426539:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510454.426561:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65c82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733d0 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510454.426656:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65c89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510454.426671:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510454.426684:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510454.426706:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788510454.426847:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed65c82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733d0 expref: 24 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510454.426864:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65c89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733d0 expref: 23 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510454.426874:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:0.0:1788510454.426877:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510454.426880:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf600, rc 0) 00000100:00100000:0.0:1788510454.426938:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:10551:x1875388852662144:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 423us (626us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788510454.426946:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 131 00000100:00100000:3.0:1788510454.436184:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510454.436398:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852662400 00000100:00100000:2.0:1788510454.436419:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852662400 00000100:00100000:2.0:1788510454.436498:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 132 00000100:00100000:2.0:1788510454.436520:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:10551:x1875388852662400:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788510454.436604:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65c97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510454.436622:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510454.436634:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510454.436864:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510454.436872:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65c97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510454.436878:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65c97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510454.436884:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510454.436888:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65c97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510454.436895:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65c97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510454.436907:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:2.0:1788510454.436911:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788510454.436916:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65c97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510454.436921:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65c97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510454.437085:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:10551:x1875388852662400:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 567us (910us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788510454.437092:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 132 00000040:00080000:0.0:1788510454.437504:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788510454.437510:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788510454.438086:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788510454.438096:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788510454.455093:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510454.455216:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510454.455298:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852662784 00000100:00100000:0.0:1788510454.455312:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852662784 00000100:00100000:0.0:1788510454.455390:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 34 00000100:00100000:0.0:1788510454.455403:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:10551:x1875388852662784:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788510454.455711:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:10551:x1875388852662784:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 310us (494us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788510454.455721:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 34 00000100:00100000:1.0:1788510454.456649:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852662528 00000100:00100000:1.0:1788510454.456663:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852662528 00000100:00100000:1.0:1788510454.456915:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:1.0:1788510454.456927:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:2343:x1875388852662528:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510454.456943:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510454.456974:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65c89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733d0 expref: 25 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510454.456990:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:1.0:1788510454.456996:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510454.457056:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:2343:x1875388852662528:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 132us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510454.457064:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:1.0:1788510454.892839:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510454.892908:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510454.892964:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510454.892997:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510454.893023:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510454.893455:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852663424 00000100:00100000:0.0:1788510454.893468:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852663424 00000100:00100000:0.0:1788510454.893541:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852663040 00000100:00100000:0.0:1788510454.893544:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852663040 00000100:00100000:0.0:1788510454.893567:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 145 00000100:00100000:0.0:1788510454.893578:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852663424:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510454.893694:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852663424:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 118us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510454.893702:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 145 00000100:00100000:0.0:1788510454.893725:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 146 00000100:00100000:0.0:1788510454.893732:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:2341:x1875388852663040:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510454.893764:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:2341:x1875388852663040:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 32us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510454.893771:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 146 00000100:00100000:0.0:1788510454.893807:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852663168 00000100:00100000:0.0:1788510454.893820:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852663168 00000100:00100000:0.0:1788510454.893857:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852663296 00000100:00100000:0.0:1788510454.893860:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852663296 00000100:00100000:0.0:1788510454.893880:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 81 00000100:00100000:0.0:1788510454.893887:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852663168:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510454.893917:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852663168:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 31us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510454.893934:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 81 00000100:00100000:0.0:1788510454.894362:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 82 00000100:00100000:0.0:1788510454.894371:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852663296:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510454.894496:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852663296:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 126us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510454.894503:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 82 00000100:00080000:1.0:1788510454.894821:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788510454.894827:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510454.897979:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852662912 00000100:00100000:2.0:1788510454.898001:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852662912 00000100:00100000:2.0:1788510454.898087:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 290 00000100:00100000:2.0:1788510454.898098:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852662912:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510454.898188:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852662912:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 91us (5399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510454.898196:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 290 00010000:00010000:0.0:1788510455.047545:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510455.493487:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861062400:0@lo:400:kworker.0 00000100:00100000:1.0:1788510455.493531:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861062272:0@lo:400:kworker.0 00000100:00100000:2.0:1788510455.493602:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861062144:0@lo:400:kworker.0 00000100:00100000:1.0:1788510455.497135:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510455.497237:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861062784:0@lo:400:kworker.0 00000100:00100000:1.0:1788510455.497283:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510455.497597:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861062784 00000100:00100000:1.0:1788510455.497608:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861062784 00000100:00100000:1.0:1788510455.497690:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788510455.497701:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3291:x1875388861062784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510455.497768:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3291:x1875388861062784:12345-0@lo:400:kworker.0 Request processed in 69us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510455.497786:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788510455.497810:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788510455.497848:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861062784:0@lo:400:kworker.0 00000100:00100000:1.0:1788510455.497898:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861062272 00000100:00100000:1.0:1788510455.497902:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861062272 00000100:00100000:1.0:1788510455.497929:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788510455.497936:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861062272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510455.497985:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861062272:12345-0@lo:400:kworker.0 Request processed in 49us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510455.497991:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788510455.498010:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861062528:0@lo:400:kworker.0 00000100:00100000:1.0:1788510455.498043:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510455.498133:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861062528 00000100:00100000:1.0:1788510455.498138:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861062528 00000100:00100000:1.0:1788510455.498168:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788510455.498185:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3289:x1875388861062528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510455.498199:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510455.498236:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3289:x1875388861062528:12345-0@lo:400:kworker.0 Request processed in 36us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510455.498243:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788510455.498245:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861062400 00000100:00100000:0.0:1788510455.498249:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861062400 00000100:00080000:1.0:1788510455.498256:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788510455.498258:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510455.498274:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861062528:0@lo:400:kworker.0 00000100:00100000:0.0:1788510455.498289:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788510455.498296:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861062272:0@lo:400:kworker.0 00000100:00100000:0.0:1788510455.498296:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861062400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510455.498338:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861062400:12345-0@lo:400:kworker.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510455.498345:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788510455.498354:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861062400:0@lo:400:kworker.0 00000100:00100000:2.0:1788510455.498634:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510455.498704:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861062656:0@lo:400:kworker.0 00000100:00100000:2.0:1788510455.498732:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510455.498767:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861062656 00000100:00100000:2.0:1788510455.498771:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861062656 00000100:00100000:2.0:1788510455.498820:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788510455.498826:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861062656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510455.498863:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861062656:12345-0@lo:400:kworker.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510455.498870:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788510455.498893:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510455.498912:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861062656:0@lo:400:kworker.0 00000100:00100000:0.0:1788510455.501565:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861062144 00000100:00100000:0.0:1788510455.501584:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861062144 00000100:00100000:0.0:1788510455.501678:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788510455.501689:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861062144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510455.501822:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861062144:12345-0@lo:400:kworker.0 Request processed in 136us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510455.501831:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788510455.501919:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861062144:0@lo:400:kworker.0 00000100:00100000:0.0:1788510456.004625:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861062912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510456.004700:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510456.004844:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861062912 00000100:00100000:1.0:1788510456.004853:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861062912 00000100:00100000:1.0:1788510456.004911:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788510456.004920:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3288:x1875388861062912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788510456.004951:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510456.004991:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3288:x1875388861062912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510456.004998:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788510456.005084:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861062912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788510456.074745:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788510456.077781:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1788510456.077907:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1788510456.078004:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:1.0:1788510456.230882:0:12138:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788510456.230896:0:12138:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788510456.230944:0:12138:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788510456.230951:0:12138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788510456.464570:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510456.464647:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852663680 00000100:00100000:3.0:1788510456.464658:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852663680 00000100:00100000:3.0:1788510456.464748:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 133 00000100:00100000:3.0:1788510456.464767:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:10571:x1875388852663680:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:3.0:1788510456.464788:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510456.464808:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65c9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733d7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.464903:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65ca5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.464929:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.464943:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510456.464954:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788510456.465087:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65c9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733d7 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.465104:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733d7 expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.465112:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:3.0:1788510456.465115:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788510456.465118:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68800, rc 0) 00000100:00100000:3.0:1788510456.465173:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:10571:x1875388852663680:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 416us (612us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788510456.465180:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 133 00000100:00080000:1.0:1788510456.465567:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510456.467961:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510456.468046:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852663808 00000100:00100000:3.0:1788510456.468056:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852663808 00000100:00100000:3.0:1788510456.468121:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 134 00000100:00100000:3.0:1788510456.468135:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:10571:x1875388852663808:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:3.0:1788510456.468260:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65cb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.468283:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.468317:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.468353:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.468360:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65cb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.468367:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.468373:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510456.468379:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.468387:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.468401:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:3.0:1788510456.468405:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788510456.468410:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65cb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510456.468418:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65cb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510456.468518:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:10571:x1875388852663808:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 386us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510456.468526:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 134 00000100:00100000:3.0:1788510456.563332:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510456.563426:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852663936 00000100:00100000:1.0:1788510456.563437:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852663936 00000100:00100000:1.0:1788510456.563507:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 46 00000100:00100000:1.0:1788510456.563518:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852663936:12345-192.168.201.4@tcp:101:cat.0 00010000:00010000:1.0:1788510456.563544:0:8183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510456.563564:0:8183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed65cba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733de expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788510456.563593:0:8183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9a80f4, atime: 0x6a9a80f3, ctime: 0x6a9a80f4, blocks: 0xb 00010000:00010000:1.0:1788510456.563612:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=314s v=(0 0) 00010000:00010000:1.0:1788510456.563617:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510456.563627:0:8183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed65cba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733de expref: 7 pid: 8183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510456.563646:0:8183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed65cba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733de expref: 7 pid: 8183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510456.563660:0:8183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032200, rc 0) 00000100:00100000:1.0:1788510456.563715:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852663936:12345-192.168.201.4@tcp:101:cat.0 Request processed in 199us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510456.563723:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 46 00000100:00080000:3.0:1788510456.563802:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788510456.568299:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510456.568536:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852664064 00000100:00100000:0.0:1788510456.568548:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852664064 00002000:00100000:0.0:1788510456.568597:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff929a8894b800 x1875388852664064/t0(0) o3->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:27/0 lens 488/0 e 0 to 0 dl 1788510467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788510456.568607:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929a8894b800 with x1875388852664064 ext(0->4095) 00002000:00010000:0.0:1788510456.568612:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929a8894b800 00000100:00100000:0.0:1788510456.568647:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 3 00000100:00100000:0.0:1788510456.568657:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2342:x1875388852664064:12345-192.168.201.4@tcp:3:cat.0 00000100:00100000:0.0:1788510456.568891:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2342:x1875388852664064:12345-192.168.201.4@tcp:3:cat.0 Request processed in 234us (601us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788510456.568899:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 3 00002000:00100000:0.0:1788510456.568907:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff929a8894b800 x1875388852664064/t0(0) o3->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:27/0 lens 488/4536 e 0 to 0 dl 1788510467 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788510456.568914:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929a8894b800 with x1875388852664064 ext(0->4095) 00002000:00010000:0.0:1788510456.568917:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929a8894b800 00010000:00010000:0.0:1788510457.092488:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510458.116448:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788510458.567555:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788510458.567586:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788510458.567631:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788510458.567639:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788510458.568464:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861063040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510458.568552:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510458.569067:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861063040 00000100:00100000:2.0:1788510458.569077:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861063040 00000100:00100000:2.0:1788510458.569149:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788510458.569159:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861063040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510458.569204:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510458.569295:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861063040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510458.569303:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788510458.569481:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510458.570511:0:3289:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788510458.570519:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1788510458.570553:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff929aaf0df800, transno 4294967304 00000100:00100000:1.0:1788510458.570575:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861063040:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788510458.648370:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1788510458.648395:0:5843:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788510458.648421:0:5843:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff929a877b80c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788510458.648426:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929ab4ecdb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff929a877b8a80 00000020:00080000:2.0:1788510458.648430:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929ab4ecd700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff929aaef5f400 00000001:00080000:2.0:1788510458.648439:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788510458.648458:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788510458.648614:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788510458.653054:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788510458.653079:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:0.0:1788510459.141057:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510460.019248:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510460.019288:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510460.019320:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510460.019342:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510460.019369:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510460.019557:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852664192 00000100:00100000:3.0:1788510460.019570:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852664192 00000100:00100000:3.0:1788510460.019637:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 292 00000100:00100000:3.0:1788510460.019649:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852664192:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510460.019744:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852664192:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 98us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510460.019752:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 292 00000100:00100000:0.0:1788510460.020049:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852664448 00000100:00100000:0.0:1788510460.020054:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852664448 00000100:00100000:0.0:1788510460.020107:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852664576 00000100:00100000:0.0:1788510460.020111:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852664576 00000100:00100000:0.0:1788510460.020134:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 85 00000100:00100000:0.0:1788510460.020142:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852664448:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510460.020177:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852664448:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 36us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510460.020184:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 85 00000100:00100000:0.0:1788510460.020198:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 86 00000100:00100000:0.0:1788510460.020204:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852664576:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510460.020255:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852664576:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 51us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510460.020261:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 86 00000100:00100000:0.0:1788510460.020280:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852664704 00000100:00100000:0.0:1788510460.020285:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852664704 00000100:00100000:0.0:1788510460.020332:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852664320 00000100:00100000:0.0:1788510460.020336:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852664320 00000100:00100000:0.0:1788510460.020355:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 150 00000100:00100000:0.0:1788510460.020361:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852664704:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510460.020465:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852664704:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 102us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510460.020472:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 150 00000100:00100000:0.0:1788510460.020486:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 151 00000100:00100000:0.0:1788510460.020492:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2341:x1875388852664320:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510460.020517:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2341:x1875388852664320:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 26us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510460.020523:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 151 00000100:00080000:3.0:1788510460.020854:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788510460.020858:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788510460.020861:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788510460.172432:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510460.617761:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861063424:0@lo:400:kworker.0 00000100:00100000:0.0:1788510460.617843:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510460.617906:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788510460.617910:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861063552:0@lo:400:kworker.0 00000100:00100000:0.0:1788510460.617928:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510460.617953:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861063424 00000100:00100000:0.0:1788510460.617959:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861063424 00000100:00100000:0.0:1788510460.618010:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788510460.618018:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861063424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510460.618074:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861063424:12345-0@lo:400:kworker.0 Request processed in 56us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510460.618079:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788510460.618131:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861063424:0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618320:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861063168:0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618354:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510460.618387:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861063680:0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618411:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510460.618433:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788510460.618439:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861063296:0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618463:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510460.618476:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861063808:0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618492:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510460.618520:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861063552 00000100:00100000:1.0:1788510460.618523:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861063552 00000100:00100000:1.0:1788510460.618565:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861063808 00000100:00100000:1.0:1788510460.618580:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861063808 00000100:00100000:1.0:1788510460.618610:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788510460.618618:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861063552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618661:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861063552:12345-0@lo:400:kworker.0 Request processed in 43us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510460.618668:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788510460.618682:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788510460.618699:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861063808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618734:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861063808:12345-0@lo:400:kworker.0 Request processed in 47us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510460.618741:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788510460.618759:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861063680 00000100:00100000:1.0:1788510460.618762:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861063680 00000100:00100000:1.0:1788510460.618779:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861063296 00000100:00100000:1.0:1788510460.618780:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861063296 00000100:00100000:1.0:1788510460.618790:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788510460.618793:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861063680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618835:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861063680:12345-0@lo:400:kworker.0 Request processed in 41us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510460.618840:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788510460.618849:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788510460.618853:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861063296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618869:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861063296:12345-0@lo:400:kworker.0 Request processed in 17us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510460.618873:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788510460.618905:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861063296:0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618911:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788510460.618916:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff929aaf0df480, transno 4294967309 00000004:00080000:1.0:1788510460.618922:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff929aaf0de300, transno 4294967310 00000004:00080000:1.0:1788510460.618926:0:3290:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788510460.618943:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861063808:0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618948:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861063680:0@lo:400:kworker.0 00000100:00100000:1.0:1788510460.618966:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861063552:0@lo:400:kworker.0 00000100:00100000:0.0:1788510460.620390:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861063168 00000100:00100000:0.0:1788510460.620405:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861063168 00000100:00100000:0.0:1788510460.620460:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788510460.620471:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861063168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510460.620562:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861063168:12345-0@lo:400:kworker.0 Request processed in 94us (2206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510460.620570:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788510460.620640:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861063168:0@lo:400:kworker.0 00000100:00080000:3.0:1788510460.620807:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788510460.620815:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788510460.620819:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510461.124599:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861063936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510461.124708:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510461.124814:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861063936 00000100:00100000:0.0:1788510461.124825:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861063936 00000100:00100000:0.0:1788510461.124884:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788510461.124895:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaa90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861063936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788510461.124944:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510461.125003:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaa90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861063936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510461.125010:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788510461.125334:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861063936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788510461.189940:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510462.080398:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510462.081631:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852664832 00000100:00100000:1.0:1788510462.081646:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852664832 00000100:00100000:1.0:1788510462.081753:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 135 00000100:00100000:1.0:1788510462.081769:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:10216:x1875388852664832:12345-192.168.201.4@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788510462.081904:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:10216:x1875388852664832:12345-192.168.201.4@tcp:60:lhsmtool_posix.0 Request processed in 141us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510462.081912:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 135 00000100:00080000:3.0:1788510462.081990:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510462.093729:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510462.094393:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852665088 00000100:00100000:2.0:1788510462.094404:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852665088 00000100:00100000:2.0:1788510462.094477:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 35 00000100:00100000:2.0:1788510462.094488:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:10216:x1875388852665088:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788510462.095036:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:10216:x1875388852665088:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 547us (1317us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788510462.095046:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 35 00010000:00010000:3.0:1788510462.212603:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510462.407202:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510462.407269:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852665216 00000100:00100000:0.0:1788510462.407281:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852665216 00000100:00100000:0.0:1788510462.407367:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 136 00000100:00100000:0.0:1788510462.407378:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+5:11024:x1875388852665216:12345-192.168.201.4@tcp:101:lsof.0 00010000:00010000:0.0:1788510462.407409:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510462.407603:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed65cc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733e5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510462.407702:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510462.407715:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510462.407727:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510462.407761:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788510462.407764:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788510462.407804:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510462.407826:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed65cc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733e5 expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510462.407845:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733e5 expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510462.407853:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:0.0:1788510462.407855:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788510462.407859:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf200, rc 0) 00000100:00100000:0.0:1788510462.407920:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+6:11024:x1875388852665216:12345-192.168.201.4@tcp:101:lsof.0 Request processed in 544us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510462.407927:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 136 00000100:00080000:3.0:1788510462.408010:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788510463.237146:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510463.690782:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861064064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788510463.690862:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510463.690989:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861064064 00000100:00100000:3.0:1788510463.690999:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861064064 00000100:00100000:3.0:1788510463.691071:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788510463.691081:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861064064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788510463.691122:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510463.691181:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861064064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510463.691200:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788510463.691264:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788510463.691787:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861064064:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788510463.745956:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1788510463.746005:0:5843:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788510463.746131:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788510463.746186:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788510464.261339:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510465.127810:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510465.127873:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510465.127960:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510465.127991:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510465.128038:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510465.128083:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852665344 00000100:00100000:0.0:1788510465.128100:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852665344 00000100:00100000:0.0:1788510465.128173:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 294 00000100:00100000:0.0:1788510465.128189:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2343:x1875388852665344:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510465.128408:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852665472 00000100:00100000:1.0:1788510465.128436:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852665472 00000100:00100000:1.0:1788510465.128510:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852665856 00000100:00100000:1.0:1788510465.128516:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852665856 00000100:00100000:1.0:1788510465.128558:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 155 00000100:00100000:1.0:1788510465.128573:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2343:x1875388852665472:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510465.128673:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2343:x1875388852665472:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 106us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510465.128681:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 155 00000100:00100000:1.0:1788510465.128699:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 156 00000100:00100000:1.0:1788510465.128704:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2343:x1875388852665856:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510465.128728:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2343:x1875388852665856:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 25us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510465.128734:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 156 00000100:00100000:1.0:1788510465.128751:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852665728 00000100:00100000:1.0:1788510465.128755:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852665728 00000100:00100000:1.0:1788510465.128777:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852665600 00000100:00100000:1.0:1788510465.128780:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852665600 00000100:00100000:1.0:1788510465.128799:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 89 00000100:00100000:1.0:1788510465.128805:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2343:x1875388852665728:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510465.128832:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2343:x1875388852665728:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 27us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510465.128838:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 89 00000100:00100000:1.0:1788510465.128849:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 90 00000100:00100000:1.0:1788510465.128856:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2343:x1875388852665600:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510465.128880:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2343:x1875388852665600:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 24us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510465.128895:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 90 00000100:00080000:1.0:1788510465.129046:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788510465.129051:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510465.129054:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510465.129470:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2343:x1875388852665344:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 1285us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510465.129478:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 294 00010000:00010000:0.0:1788510465.284492:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510465.733517:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861064576:0@lo:400:kworker.0 00000100:00100000:2.0:1788510465.733622:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510465.733704:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788510465.733710:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861064448:0@lo:400:kworker.0 00000100:00100000:2.0:1788510465.733739:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510465.733839:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861064320:0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.733871:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510465.733898:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861064832:0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.733921:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510465.733942:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788510465.733948:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861064192:0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.733976:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510465.733996:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861064704:0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734014:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510465.734039:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861064576 00000100:00100000:1.0:1788510465.734047:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861064576 00000100:00100000:1.0:1788510465.734103:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861064832 00000100:00100000:1.0:1788510465.734106:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861064832 00000100:00100000:1.0:1788510465.734128:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788510465.734135:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861064576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734190:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861064576:12345-0@lo:400:kworker.0 Request processed in 54us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510465.734197:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788510465.734259:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788510465.734265:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861064832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734296:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861064832:12345-0@lo:400:kworker.0 Request processed in 32us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510465.734320:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788510465.734340:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861064192 00000100:00100000:1.0:1788510465.734343:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861064192 00000100:00100000:1.0:1788510465.734367:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788510465.734374:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861064192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734404:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861064192:12345-0@lo:400:kworker.0 Request processed in 31us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510465.734410:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788510465.734444:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861064448 00000100:00100000:1.0:1788510465.734447:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861064448 00000100:00100000:1.0:1788510465.734471:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861064320 00000100:00100000:1.0:1788510465.734474:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861064320 00000100:00100000:1.0:1788510465.734483:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861064704 00000100:00100000:1.0:1788510465.734486:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861064704 00000100:00100000:1.0:1788510465.734499:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788510465.734505:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861064448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734533:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861064448:12345-0@lo:400:kworker.0 Request processed in 29us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510465.734539:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788510465.734551:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788510465.734556:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861064320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734581:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861064320:12345-0@lo:400:kworker.0 Request processed in 25us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510465.734586:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788510465.734595:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788510465.734613:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861064704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734650:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861064704:12345-0@lo:400:kworker.0 Request processed in 38us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510465.734657:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1788510465.734681:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788510465.734687:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510465.734689:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510465.734721:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861064192:0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734735:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861064704:0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734745:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861064320:0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734754:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861064832:0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734789:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861064448:0@lo:400:kworker.0 00000100:00100000:1.0:1788510465.734799:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861064576:0@lo:400:kworker.0 00000100:00100000:0.0:1788510466.244811:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788510466.244835:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861064960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510466.244912:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510466.244985:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861064960 00000100:00100000:0.0:1788510466.244994:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861064960 00000100:00100000:0.0:1788510466.245040:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788510466.245049:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861064960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788510466.245085:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510466.245130:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861064960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510466.245137:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788510466.245182:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861064960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788510466.318904:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788510467.242851:0:12340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:27:44 (1788510464) 00010000:00010000:0.0:1788510467.335408:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510468.356517:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510468.804666:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510468.804707:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861065088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510468.804784:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510468.805110:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861065088 00000100:00100000:3.0:1788510468.805124:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861065088 00000100:00100000:3.0:1788510468.805216:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788510468.805248:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861065088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788510468.805297:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510468.805360:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861065088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510468.805369:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000040:00080000:3.0:1788510468.805573:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510468.805579:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510468.806816:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788510468.806826:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00080000:1.0:1788510468.807270:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788510468.807691:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861065088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788510469.125279:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510469.125500:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852666112 00000100:00100000:1.0:1788510469.125513:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852666112 00000100:00100000:1.0:1788510469.125651:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 137 00000100:00100000:1.0:1788510469.125664:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:11289:x1875388852666112:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788510469.125687:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510469.125707:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65ccf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733ec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788510469.126285:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788510469.126353:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65cd6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.126370:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65cd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.126381:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65cd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.126396:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65cdd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.126402:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65cdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.126409:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65cdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.128018:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65ce4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.128049:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.128062:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510469.128081:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788510469.129490:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65cd6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.129505:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65cd6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130124:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65cd6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130130:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510469.130134:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65cd6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130142:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65cd6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130168:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff929a8b8f5500) 00010000:00010000:1.0:1788510469.130172:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510469.130177:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65cd6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130184:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65cd6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130202:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65cdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130208:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65cdd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130213:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65cdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130218:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510469.130280:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65cdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130298:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65cdd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130307:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff929a82b92600) 00010000:00010000:1.0:1788510469.130309:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510469.130312:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65cdd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.130317:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65cdd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.132102:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65ccf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ec expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.132138:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ec expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.132148:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:1.0:1788510469.132151:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510469.132163:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033000, rc 0) 00000100:00100000:1.0:1788510469.132283:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:11289:x1875388852666112:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 6621us (7012us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788510469.132292:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 137 00000100:00100000:1.0:1788510469.141159:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510469.141361:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852666240 00000100:00100000:2.0:1788510469.141373:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852666240 00000100:00100000:2.0:1788510469.141439:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 138 00000100:00100000:2.0:1788510469.141450:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:11289:x1875388852666240:12345-192.168.201.4@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788510469.141611:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:11289:x1875388852666240:12345-192.168.201.4@tcp:59:lhsmtool_posix.0 Request processed in 163us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510469.141620:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 138 00000100:00100000:2.0:1788510469.145305:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510469.151409:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852666368 00000100:00100000:1.0:1788510469.151428:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852666368 00000100:00100000:1.0:1788510469.151519:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:1.0:1788510469.151532:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:2343:x1875388852666368:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510469.151580:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510469.151614:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65ce4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733ec expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510469.151637:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:1.0:1788510469.151642:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510469.151711:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:2343:x1875388852666368:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 181us (6416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510469.151718:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 10 00010000:00010000:0.0:1788510469.384343:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788510469.829053:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510469.829065:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510469.833213:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1788510469.833698:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788510470.261184:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510470.261265:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510470.261292:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510470.261373:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510470.261418:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852666880 00000100:00100000:2.0:1788510470.261428:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852666880 00000100:00100000:2.0:1788510470.261484:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852666752 00000100:00100000:2.0:1788510470.261487:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852666752 00000100:00100000:2.0:1788510470.261512:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 93 00000100:00100000:2.0:1788510470.261534:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2343:x1875388852666880:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510470.261623:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2343:x1875388852666880:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 101us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510470.261651:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 93 00000100:00100000:2.0:1788510470.261670:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 94 00000100:00100000:2.0:1788510470.261676:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852666752:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510470.261702:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852666752:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510470.261708:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 94 00000100:00080000:2.0:1788510470.261733:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788510470.261737:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788510470.261969:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852666624 00000100:00100000:1.0:1788510470.261974:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852666624 00000100:00100000:1.0:1788510470.262017:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 160 00000100:00100000:1.0:1788510470.262026:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:2343:x1875388852666624:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510470.262073:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:2343:x1875388852666624:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 49us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510470.262080:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 160 00000100:00100000:3.0:1788510470.264033:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852666496 00000100:00100000:3.0:1788510470.264050:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852666496 00000100:00100000:3.0:1788510470.264185:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 296 00000100:00100000:3.0:1788510470.264196:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2342:x1875388852666496:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510470.264322:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2342:x1875388852666496:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 128us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510470.264331:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 296 00000100:00100000:2.0:1788510470.278580:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510470.278730:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852667008 00000100:00100000:3.0:1788510470.278746:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852667008 00000100:00100000:3.0:1788510470.278854:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 161 00000100:00100000:3.0:1788510470.278873:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2342:x1875388852667008:12345-192.168.201.4@tcp:400:kworker.0 00000100:00080000:0.0:1788510470.278979:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510470.279000:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2342:x1875388852667008:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 132us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510470.279014:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 161 00010000:00010000:2.0:1788510470.418534:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510470.852540:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861065344:0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.852615:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510470.852682:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861065856:0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.852712:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510470.852745:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788510470.852750:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861065216:0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.852779:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510470.852801:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861065728:0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.852823:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510470.852850:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861065472:0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.852875:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510470.852895:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788510470.852901:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861065600:0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.852922:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510470.852973:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861065344 00000100:00100000:2.0:1788510470.852982:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861065344 00000100:00100000:2.0:1788510470.853037:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861065728 00000100:00100000:2.0:1788510470.853041:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861065728 00000100:00100000:2.0:1788510470.853087:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861065472 00000100:00100000:2.0:1788510470.853091:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861065472 00000100:00100000:2.0:1788510470.853114:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788510470.853135:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861065344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.853199:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861065344:12345-0@lo:400:kworker.0 Request processed in 75us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510470.853207:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788510470.853267:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788510470.853273:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861065728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.853301:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861065728:12345-0@lo:400:kworker.0 Request processed in 29us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510470.853307:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788510470.853317:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788510470.853323:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861065472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.853375:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861065472:12345-0@lo:400:kworker.0 Request processed in 52us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510470.853381:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788510470.853401:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861065216 00000100:00100000:2.0:1788510470.853404:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861065216 00000100:00100000:2.0:1788510470.853434:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788510470.853440:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861065216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.853470:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3291:x1875388861065216:12345-0@lo:400:kworker.0 Request processed in 31us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510470.853487:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788510470.853535:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861065856 00000100:00100000:2.0:1788510470.853540:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861065856 00000100:00100000:2.0:1788510470.853570:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861065600 00000100:00100000:2.0:1788510470.853573:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861065600 00000100:00100000:2.0:1788510470.853596:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788510470.853603:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861065856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.853636:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861065856:12345-0@lo:400:kworker.0 Request processed in 34us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510470.853643:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788510470.853653:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788510470.853658:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861065600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.853684:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861065600:12345-0@lo:400:kworker.0 Request processed in 26us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510470.853690:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1788510470.853711:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788510470.853715:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788510470.853718:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510470.853861:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861065600:0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.853875:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861065472:0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.853916:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:040cea51-0882-49ef-ac64-3cc6497ba05a:3291:1875388861065216:0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.853927:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861065728:0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.853937:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861065344:0@lo:400:kworker.0 00000100:00100000:2.0:1788510470.853946:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861065856:0@lo:400:kworker.0 00000100:00100000:0.0:1788510471.373613:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788510471.373649:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861065984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510471.373803:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510471.373899:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861065984 00000100:00100000:0.0:1788510471.373908:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861065984 00000100:00100000:0.0:1788510471.373962:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788510471.373972:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861065984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788510471.374018:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510471.374069:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861065984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510471.374075:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788510471.374133:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861065984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788510471.430514:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510471.600396:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510471.600465:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852667136 00000100:00100000:1.0:1788510471.600474:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852667136 00000100:00100000:1.0:1788510471.600567:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 139 00000100:00100000:1.0:1788510471.600579:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:11331:x1875388852667136:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510471.600599:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510471.600620:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65cf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733f3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.600684:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65cf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.600711:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65cf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.600722:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65cf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.600737:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65d00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.600743:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.600749:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.600977:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65cf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.600986:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65cf9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601006:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65cf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601012:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510471.601017:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65cf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601023:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65cf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601035:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510471.601052:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510471.601059:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65cf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601066:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65cf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601078:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601084:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65d00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601091:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65d00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601096:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510471.601163:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65d00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601170:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65d00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601179:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff929a82b92600) 00010000:00010000:1.0:1788510471.601181:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510471.601184:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65d00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601190:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65d00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601248:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65cf2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733f3 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601272:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510471.601274:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510471.601278:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65cf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733f3 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.601287:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032400, rc 0) 00000100:00100000:1.0:1788510471.601354:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:11331:x1875388852667136:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 777us (969us total) trans 0 rc 301/301 00000100:00100000:1.0:1788510471.601362:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 139 00000100:00080000:0.0:1788510471.601479:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510471.608871:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510471.609057:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852667392 00000100:00100000:0.0:1788510471.609067:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852667392 00000100:00100000:0.0:1788510471.609123:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 140 00000100:00100000:0.0:1788510471.609133:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:11331:x1875388852667392:12345-192.168.201.4@tcp:36:lfs.0 00010000:00010000:0.0:1788510471.609191:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510471.609218:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65670 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7322c expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.609257:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:0.0:1788510471.609270:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510471.609477:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.609491:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733e5 expref: 5 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.609512:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.609545:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733e5 expref: 5 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.609559:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733e5 expref: 5 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510471.609586:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861066112:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510471.609700:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa51a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510471.612399:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510471.612534:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852667520 00000100:00100000:1.0:1788510471.612545:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852667520 00010000:00010000:1.0:1788510471.612585:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733e5 expref: 6 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510471.612626:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 61 00000100:00100000:1.0:1788510471.612637:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2341:x1875388852667520:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510471.612650:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510471.612658:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733e5 expref: 6 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.612671:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733e5 expref: 6 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.612694:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510471.612700:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.612717:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.612724:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.612743:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510471.612801:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2341:x1875388852667520:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 166us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510471.612809:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 61 00010000:00010000:0.0:1788510471.613304:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65cc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733e5 expref: 5 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510471.613323:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861066112:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510471.613344:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.613354:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.613360:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.613402:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65d0e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.613412:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65d0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.613420:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65d0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510471.615574:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788510471.615592:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.615601:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.615609:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.615615:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510471.615621:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.615630:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.615648:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510471.615651:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510471.615657:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.615670:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65d07 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788510471.615694:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027ecd015 reply state 00000000732c04df transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65d0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510471.615703:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788510471.615845:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:11331:x1875388852667392:12345-192.168.201.4@tcp:36:lfs.0 Request processed in 6708us (6980us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788510471.615854:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 140 00010000:00010000:3.0:1788510471.622618:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65d0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.622639:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65d0e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.622648:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65d0e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.622655:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510471.622662:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65d0e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.622685:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65d0e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.622709:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff929a8b8f5c00) 00010000:00010000:3.0:1788510471.622712:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510471.622718:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65d0e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.622725:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65d0e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510471.710482:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510471.710531:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852667648 00000100:00100000:3.0:1788510471.710542:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852667648 00000100:00100000:3.0:1788510471.710597:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 141 00000100:00100000:3.0:1788510471.710607:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:11339:x1875388852667648:12345-192.168.201.4@tcp:101:lctl.0 00010000:00010000:3.0:1788510471.710630:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510471.710652:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65d15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc733fa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.710713:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65d1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.710725:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.710736:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510471.710769:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788510471.710780:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510471.710806:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.710830:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65d15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733fa expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.710845:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65d1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733fa expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510471.710854:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eab100) 00010000:00010000:3.0:1788510471.710856:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788510471.710860:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68e00, rc 0) 00000100:00100000:3.0:1788510471.710915:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:11339:x1875388852667648:12345-192.168.201.4@tcp:101:lctl.0 Request processed in 310us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510471.710922:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 141 00000100:00100000:0.0:1788510471.804341:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510471.804432:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852667776 00000100:00100000:3.0:1788510471.804442:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852667776 00000100:00100000:2.0:1788510471.804550:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 142 00000100:00100000:2.0:1788510471.804561:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+15:11345:x1875388852667776:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510471.804595:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510471.804616:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65d23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73401 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804671:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65d2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804683:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65d2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804692:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65d2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804702:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65d31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804706:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65d31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804710:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65d31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804843:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65d38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804849:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804853:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510471.804890:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788510471.804893:0:9544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510471.804908:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804918:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65d2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804923:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65d2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804928:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65d2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804932:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510471.804935:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65d2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804940:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65d2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804948:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eab100) 00010000:00010000:2.0:1788510471.804950:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510471.804954:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65d2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804957:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65d2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804966:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65d31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804976:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65d31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804980:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65d31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804983:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510471.804985:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65d31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.804998:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65d31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.805003:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff929aac578d00) 00010000:00010000:2.0:1788510471.805004:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510471.805006:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65d31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.805009:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65d31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.805390:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed65d23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73401 expref: 17 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.805404:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65d38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73401 expref: 16 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.805409:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:2.0:1788510471.805411:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788510471.805418:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77000, rc 0) 00000100:00100000:0.0:1788510471.810561:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:11345:x1875388852667776:12345-192.168.201.4@tcp:101:bash.0 Request processed in 5986us (6213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510471.810708:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 142 00000100:00100000:3.0:1788510471.814060:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510471.814290:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852668032 00000100:00100000:0.0:1788510471.814300:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852668032 00000100:00100000:0.0:1788510471.814360:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 143 00000100:00100000:0.0:1788510471.814371:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:11345:x1875388852668032:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:0.0:1788510471.814392:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510471.814414:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65d3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73408 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.814551:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.814644:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.814658:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.814693:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65d4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.814701:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65d4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.814708:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65d4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788510471.815703:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788510471.816421:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.816438:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.816450:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.816502:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.816509:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.816517:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.816523:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510471.816528:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.816553:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.816638:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510471.816642:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510471.816648:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d46 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.816654:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510471.816670:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005226fd9b reply state 0000000028d62869 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65d4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510471.816680:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788510471.816718:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65d3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73408 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.816733:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73408 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.816741:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5000) 00010000:00010000:0.0:1788510471.816743:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510471.816746:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae400, rc 0) 00000100:00100000:0.0:1788510471.816883:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11345:x1875388852668032:12345-192.168.201.4@tcp:101:bash.0 Request processed in 2513us (2832us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788510471.816892:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 143 00010000:00010000:0.0:1788510471.819320:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65d4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.819362:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65d4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.819370:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65d4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.819376:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510471.819381:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65d4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.819388:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65d4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.819404:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a8b8f5800) 00010000:00010000:0.0:1788510471.819408:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510471.819413:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65d4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.819419:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65d4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510471.822445:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510471.822512:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852668160 00000100:00100000:0.0:1788510471.822524:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852668160 00000100:00100000:0.0:1788510471.822601:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 47 00000100:00100000:0.0:1788510471.822613:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852668160:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:0.0:1788510471.822631:0:8183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510471.822652:0:8183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001679476c/0x3e734462ed65d62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7340f expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788510471.822704:0:8183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788510471.822725:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1788510471.822730:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510471.822740:0:8183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001679476c/0x3e734462ed65d62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7340f expref: 6 pid: 8183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.822758:0:8183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001679476c/0x3e734462ed65d62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7340f expref: 6 pid: 8183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510471.822771:0:8183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafa00, rc 0) 00000100:00100000:0.0:1788510471.822841:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852668160:12345-192.168.201.4@tcp:101:bash.0 Request processed in 230us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510471.822849:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 47 00000100:00100000:1.0:1788510471.825701:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510471.825891:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852668288 00000100:00100000:2.0:1788510471.825900:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852668288 00000100:00100000:2.0:1788510471.825956:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 48 00000100:00100000:2.0:1788510471.825967:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:11345:x1875388852668288:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510471.825988:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510471.826009:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73416 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.826055:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001679476c/0x3e734462ed65d62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7340f expref: 7 pid: 8183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.826062:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510471.826065:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510471.826069:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.826095:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001679476c/0x3e734462ed65d62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7340f expref: 7 pid: 8183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.826105:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001679476c/0x3e734462ed65d62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7340f expref: 7 pid: 8183 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510471.826124:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1875388861066240:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510471.826218:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c90e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510471.831953:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1875388861066240:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510471.832006:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.832041:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77800, rc 0) 00000100:00100000:2.0:1788510471.832105:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:11345:x1875388852668288:12345-192.168.201.4@tcp:101:bash.0 Request processed in 6140us (6415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510471.832125:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 48 00000100:00100000:3.0:1788510471.834547:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510471.834641:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852668416 00000100:00100000:2.0:1788510471.834650:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852668416 00010000:00010000:2.0:1788510471.834684:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001679476c/0x3e734462ed65d62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7340f expref: 7 pid: 8183 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510471.834716:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 62 00000100:00100000:2.0:1788510471.834723:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852668416:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510471.834735:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510471.834753:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001679476c/0x3e734462ed65d62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7340f expref: 7 pid: 8183 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.834763:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001679476c/0x3e734462ed65d62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7340f expref: 7 pid: 8183 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.834785:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001679476c/0x3e734462ed65d62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7340f expref: 7 pid: 8183 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.834801:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510471.834805:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510471.834827:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.834838:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510471.834877:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510471.834888:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1875388861066368:192.168.201.4@tcp:105: 00000100:00100000:2.0:1788510471.834964:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c90e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510471.842257:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1875388861066368:192.168.201.4@tcp:105: 00010000:00010000:2.0:1788510471.842292:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510471.842573:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852668416:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 7845us (8029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510471.842591:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 62 00000100:00100000:0.0:1788510471.851533:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510471.851908:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852668672 00000100:00100000:3.0:1788510471.851920:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852668672 00000100:00100000:3.0:1788510471.851979:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 36 00000100:00100000:3.0:1788510471.851988:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11345:x1875388852668672:12345-192.168.201.4@tcp:35:bash.0 00000100:00100000:3.0:1788510471.852395:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11345:x1875388852668672:12345-192.168.201.4@tcp:35:bash.0 Request processed in 407us (876us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788510471.852403:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 36 00000100:00100000:3.0:1788510471.930343:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510471.930424:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852668928 00000100:00100000:1.0:1788510471.930435:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852668928 00000100:00100000:1.0:1788510471.930601:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 144 00000100:00100000:1.0:1788510471.930614:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11355:x1875388852668928:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510471.930647:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510471.930674:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65d70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7341d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510471.930842:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788510471.931624:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65d70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7341d expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.931643:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eab100) 00010000:00010000:1.0:1788510471.931646:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788510471.931651:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65d70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7341d expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510471.931687:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033400, rc 0) 00000100:00100000:0.0:1788510471.932165:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11355:x1875388852668928:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 1550us (1832us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788510471.932176:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 144 00000100:00100000:1.0:1788510471.953855:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510471.954014:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852669184 00000100:00100000:3.0:1788510471.954026:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852669184 00000100:00100000:3.0:1788510471.954088:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 37 00000100:00100000:3.0:1788510471.954098:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11355:x1875388852669184:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510471.954383:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:11355:x1875388852669184:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 286us (538us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788510471.954392:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 37 00000100:00100000:3.0:1788510472.026094:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510472.026261:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852669312 00000100:00100000:1.0:1788510472.026274:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852669312 00000100:00100000:1.0:1788510472.026359:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 145 00000100:00100000:1.0:1788510472.026371:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:11361:x1875388852669312:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510472.026403:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510472.026436:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65d7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73424 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.026666:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.026683:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.026696:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510472.026745:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788510472.026750:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510472.026774:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.026807:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed65d7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73424 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.026827:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73424 expref: 22 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.026844:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:1.0:1788510472.026847:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788510472.026851:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033000, rc 0) 00000100:00100000:1.0:1788510472.026964:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:11361:x1875388852669312:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 596us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510472.026972:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 145 00000100:00100000:1.0:1788510472.033890:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510472.033972:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852669568 00000100:00100000:0.0:1788510472.033985:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852669568 00000100:00100000:0.0:1788510472.034051:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 146 00000100:00100000:0.0:1788510472.034062:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:11361:x1875388852669568:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510472.034099:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510472.034129:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65d8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7342b expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.034260:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.034276:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.034288:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510472.034299:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788510472.034422:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65d8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7342b expref: 25 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.034440:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7342b expref: 24 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.034449:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5000) 00010000:00010000:0.0:1788510472.034452:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510472.034455:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf000, rc 0) 00000100:00100000:0.0:1788510472.034544:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:11361:x1875388852669568:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 484us (663us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788510472.034551:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 146 00000100:00100000:2.0:1788510472.045635:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510472.045692:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510472.045766:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852669696 00000100:00100000:1.0:1788510472.045780:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852669696 00000100:00100000:1.0:1788510472.045850:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:1.0:1788510472.045860:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:2343:x1875388852669696:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510472.045876:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510472.045899:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65d93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7342b expref: 24 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.045916:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5000) 00010000:00010000:1.0:1788510472.045921:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510472.045981:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:2343:x1875388852669696:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 122us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510472.045997:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:0.0:1788510472.046130:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852669952 00000100:00100000:0.0:1788510472.046135:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852669952 00000100:00100000:0.0:1788510472.046175:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 147 00000100:00100000:0.0:1788510472.046199:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:11361:x1875388852669952:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510472.046219:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510472.046263:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65da1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73432 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.046361:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed65da8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.046377:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed65da8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.046389:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed65da8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510472.046402:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788510472.046541:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65da1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73432 expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.046556:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed65da8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73432 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.046564:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5000) 00010000:00010000:0.0:1788510472.046567:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788510472.046570:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafe00, rc 0) 00000100:00100000:0.0:1788510472.046599:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:11361:x1875388852669952:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 402us (906us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788510472.046605:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 147 00000100:00100000:3.0:1788510472.051793:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510472.051895:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852670080 00000100:00100000:1.0:1788510472.051906:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852670080 00000100:00100000:1.0:1788510472.052672:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00100000:1.0:1788510472.052684:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852670080:12345-192.168.201.4@tcp:1:lfs.0 00010000:00010000:1.0:1788510472.052726:0:12047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.052757:0:12047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.052765:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510472.052769:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788510472.052774:0:12047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.052807:0:12047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.052820:0:12047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 6 pid: 6670 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510472.052835:0:12047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12047:1875388861066496:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510472.053075:0:12047:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b33900 going to sleep for 11 seconds 00000100:00080000:0.0:1788510472.053167:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510472.058353:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510472.058455:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852670208 00000100:00100000:3.0:1788510472.058462:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852670208 00000100:00100000:1.0:1788510472.058475:0:12047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12047:1875388861066496:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510472.058520:0:12047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1788510472.058533:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff929a8578f800 x1875388852670208/t0(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:43/0 lens 504/0 e 0 to 0 dl 1788510483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788510472.058544:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929a8578f800 with x1875388852670208 ext(0->12) 00010000:00010000:3.0:1788510472.058553:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 7 pid: 6670 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.058568:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 7 pid: 6670 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788510472.058576:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff929a8578f800 00000100:00100000:3.0:1788510472.058672:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 2 00000100:00100000:3.0:1788510472.058684:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852670208:12345-192.168.201.4@tcp:4:lfs.0 00000100:00100000:3.0:1788510472.059435:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2341:x1875388852670208:12345-192.168.201.4@tcp:4:lfs.0 Request processed in 749us (1087us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788510472.059455:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 2 00002000:00100000:3.0:1788510472.059464:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff929a8578f800 x1875388852670208/t4294967305(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:43/0 lens 504/448 e 0 to 0 dl 1788510483 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788510472.059473:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929a8578f800 with x1875388852670208 ext(0->12) 00010000:00010000:3.0:1788510472.059480:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 9 pid: 6670 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.059507:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 9 pid: 6670 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788510472.059515:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff929a8578f800 00000100:00100000:3.0:1788510472.066652:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510472.066762:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852670336 00000100:00100000:0.0:1788510472.066785:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852670336 00010000:00010000:0.0:1788510472.066823:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 9 pid: 6670 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510472.066924:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 63 00000100:00100000:0.0:1788510472.066935:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2340:x1875388852670336:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510472.066951:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788510472.066971:0:5806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788510472.066975:0:5806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788510471 00002000:00010000:0.0:1788510472.066977:0:5806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788510472 00002000:00010000:0.0:1788510472.066979:0:5806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788510471 00010000:00010000:0.0:1788510472.066986:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 9 pid: 6670 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.067001:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 9 pid: 6670 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.067037:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d44b004/0x3e734462ed65d69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73416 expref: 9 pid: 6670 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.067055:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788510472.067060:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788510472.067066:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.067076:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.067343:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510472.067399:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852670336:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 465us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510472.067407:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 63 00010000:00010000:2.0:1788510472.069292:0:12047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.069312:0:12047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.069352:0:12047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.069361:0:12047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.069388:0:12047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.069395:0:12047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033e00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510472.069399:0:12047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.069408:0:12047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.069425:0:12047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.069433:0:12047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a53d146c/0x3e734462ed65db6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510472.069591:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852670080:12345-192.168.201.4@tcp:1:lfs.0 Request processed in 16905us (17804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510472.069601:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00100000:2.0:1788510472.078513:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510472.078600:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852670592 00000100:00100000:3.0:1788510472.078613:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852670592 00000100:00100000:3.0:1788510472.078720:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 38 00000100:00100000:3.0:1788510472.078733:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:11361:x1875388852670592:12345-192.168.201.4@tcp:35:lfs.0 00000004:00010000:3.0:1788510472.078824:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed65da8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73432 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788510472.079444:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788510472.079505:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788510472.080086:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788510472.081004:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.081391:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65d54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73408 expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.081416:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.081459:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73408 expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.081474:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65d54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73408 expref: 29 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510472.081500:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae948a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1875388861066624:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510472.081656:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c79000 going to sleep for 11 seconds 00000100:00100000:1.0:1788510472.085068:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510472.085161:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852670720 00000100:00100000:2.0:1788510472.085171:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852670720 00010000:00010000:2.0:1788510472.085213:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65d54 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73408 expref: 30 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510472.085293:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 64 00000100:00100000:2.0:1788510472.085321:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:2340:x1875388852670720:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510472.085340:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510472.085348:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65d54 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73408 expref: 30 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.085362:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65d54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73408 expref: 30 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.085384:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5000) 00010000:00010000:2.0:1788510472.085391:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.085400:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.085407:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.085425:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510472.085501:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+30:2340:x1875388852670720:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 170us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510472.085508:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 64 00010000:00010000:3.0:1788510472.086862:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed65d54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73408 expref: 29 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510472.086888:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae948a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1875388861066624:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510472.086917:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.086928:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.086934:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788510472.087099:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788510472.087676:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788510472.087825:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae948a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1875388861066752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788510472.087926:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510472.087971:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c79a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788510472.088209:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861066752 00000100:00100000:1.0:1788510472.088217:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861066752 00000100:00100000:1.0:1788510472.088316:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788510472.088326:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1875388861066752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788510472.088406:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1875388861066752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510472.088413:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788510472.088564:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788510472.088663:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae948a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1875388861066752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788510472.090592:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788510472.090732:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1875388861066880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788510472.090826:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510472.090939:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c90b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788510472.090996:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861066880 00000100:00100000:1.0:1788510472.091005:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861066880 00000100:00100000:1.0:1788510472.091706:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788510472.091725:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1875388861066880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788510472.092030:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5825:x1875388861066880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 302us (1195us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788510472.092039:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788510472.092168:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1875388861066880:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788510472.092295:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788510472.092350:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.092362:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.092371:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.092377:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510472.092383:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.092392:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.092414:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5000) 00010000:00010000:2.0:1788510472.092417:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788510472.092423:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.092429:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed65dbd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788510472.092672:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788510472.092779:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788510472.092791:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329911567421ns, next at 330911565199ns, rc = 0 00000001:00080000:2.0:1788510472.092797:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788510472.092828:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5000) 00010000:00010000:2.0:1788510472.092831:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788510472.092847:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed65da8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73432 expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510472.092981:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:11361:x1875388852670592:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 14250us (14493us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788510472.092990:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 38 00000020:00080000:2.0:1788510472.092994:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788510472.096094:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510472.096278:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852670848 00000100:00100000:2.0:1788510472.096289:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852670848 00000100:00100000:2.0:1788510472.096349:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 148 00000100:00100000:2.0:1788510472.096359:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:11361:x1875388852670848:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510472.096385:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510472.096413:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65dc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73439 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.096477:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73439 expref: 33 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.096504:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73439 expref: 33 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.096523:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:2.0:1788510472.096526:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788510472.096530:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76000, rc 0) 00000100:00100000:2.0:1788510472.096590:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+33:11361:x1875388852670848:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 232us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510472.096596:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 148 00000100:00100000:0.0:1788510472.100044:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510472.100211:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852671104 00000100:00100000:2.0:1788510472.100288:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852671104 00000100:00100000:2.0:1788510472.100365:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 39 00000100:00100000:2.0:1788510472.100377:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+33:11361:x1875388852671104:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:2.0:1788510472.100646:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+34:11361:x1875388852671104:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 271us (624us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788510472.100654:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 39 00000100:00100000:3.0:1788510472.198383:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510472.198543:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852671360 00000100:00100000:0.0:1788510472.198556:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852671360 00000100:00100000:0.0:1788510472.198626:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 149 00000100:00100000:0.0:1788510472.198637:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+34:11371:x1875388852671360:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510472.198671:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510472.198698:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65dcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73440 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510472.198793:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788510472.198930:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65dcb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73440 expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.198947:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eab100) 00010000:00010000:0.0:1788510472.198950:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788510472.198956:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65dcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73440 expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.198971:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf200, rc 0) 00000100:00100000:0.0:1788510472.199045:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+35:11371:x1875388852671360:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 409us (671us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788510472.199079:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 149 00000100:00100000:0.0:1788510472.203731:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510472.203815:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852671488 00000100:00100000:2.0:1788510472.203826:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852671488 00000100:00100000:2.0:1788510472.203896:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 150 00000100:00100000:2.0:1788510472.203909:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+35:11371:x1875388852671488:12345-192.168.201.4@tcp:34:lfs.0 00010000:00010000:2.0:1788510472.204001:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65dd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204020:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204034:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204051:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65de0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204058:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204064:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204507:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65de7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204535:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204545:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788510472.204596:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204609:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204615:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65dd9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204621:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204628:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510472.204632:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204640:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204653:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:2.0:1788510472.204656:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510472.204660:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65dd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204667:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65dd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204690:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204696:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65de0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204702:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204707:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510472.204709:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204714:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65de0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204721:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929aac578b00) 00010000:00010000:2.0:1788510472.204723:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510472.204726:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65de0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204731:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65de0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204746:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204751:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65de7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204756:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204766:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510472.204769:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204774:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65de7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204781:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:2.0:1788510472.204783:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510472.204785:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65de7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.204790:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65de7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510472.204897:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+35:11371:x1875388852671488:12345-192.168.201.4@tcp:34:lfs.0 Request processed in 989us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510472.204907:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 150 00000100:00100000:2.0:1788510472.208244:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510472.208394:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852671744 00000100:00100000:0.0:1788510472.208407:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852671744 00000100:00100000:0.0:1788510472.208475:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 40 00000100:00100000:0.0:1788510472.208494:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+35:11371:x1875388852671744:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:0.0:1788510472.208778:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:11371:x1875388852671744:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 294us (569us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788510472.208787:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 40 00000100:00100000:3.0:1788510472.250525:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510472.250668:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852672000 00000100:00100000:0.0:1788510472.250678:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852672000 00000100:00100000:0.0:1788510472.250762:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 151 00000100:00100000:0.0:1788510472.250774:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:11374:x1875388852672000:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510472.250806:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510472.250833:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65dee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73447 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.250936:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65df5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.250956:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65df5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.250968:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65df5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.250986:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251011:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251019:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251177:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65e03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251188:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251195:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510472.251204:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788510472.251365:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65df5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251373:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65df5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251380:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65df5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251387:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510472.251392:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65df5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251400:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65df5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251423:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510472.251426:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510472.251431:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65df5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251438:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65df5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251451:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251457:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65dfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251463:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251468:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafa00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510472.251471:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251477:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251497:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a8b8f5800) 00010000:00010000:0.0:1788510472.251499:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510472.251503:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65dfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251509:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251566:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65dee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73447 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251582:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65e03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73447 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.251589:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:0.0:1788510472.251591:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510472.251594:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae000, rc 0) 00000100:00100000:0.0:1788510472.251677:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+38:11374:x1875388852672000:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 904us (1161us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788510472.251686:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 151 00000100:00100000:1.0:1788510472.257081:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510472.257336:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852672128 00000100:00100000:2.0:1788510472.257350:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852672128 00000100:00100000:2.0:1788510472.257422:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 152 00000100:00100000:2.0:1788510472.257434:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+38:11374:x1875388852672128:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:2.0:1788510472.257528:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.257551:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.257584:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.257617:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.257624:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.257632:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.257639:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510472.257643:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.257651:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.257663:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:2.0:1788510472.257666:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788510472.257670:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.257676:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510472.257755:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+38:11374:x1875388852672128:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 323us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510472.257764:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 152 00000100:00100000:2.0:1788510472.261925:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510472.263275:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852672384 00000100:00100000:3.0:1788510472.263295:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852672384 00000100:00100000:3.0:1788510472.263385:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 41 00000100:00100000:3.0:1788510472.263398:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+38:11374:x1875388852672384:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510472.263790:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+39:11374:x1875388852672384:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 392us (1875us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788510472.263798:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 41 00010000:00010000:2.0:1788510472.461416:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510472.494447:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510472.494890:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852672640 00000100:00100000:0.0:1788510472.494902:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852672640 00000100:00100000:0.0:1788510472.494973:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 153 00000100:00100000:0.0:1788510472.494984:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+39:11406:x1875388852672640:12345-192.168.201.4@tcp:101:cat.0 00010000:00010000:0.0:1788510472.495015:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510472.495036:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7344e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.495175:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65e1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.495193:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.495209:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510472.495292:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788510472.495450:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7344e expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.495469:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7344e expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.495478:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:0.0:1788510472.495492:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510472.495497:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafa00, rc 0) 00000100:00100000:0.0:1788510472.495556:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+41:11406:x1875388852672640:12345-192.168.201.4@tcp:101:cat.0 Request processed in 574us (1126us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788510472.495564:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 153 00000100:00100000:1.0:1788510472.502720:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510472.502813:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510472.502923:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852672768 00000100:00100000:0.0:1788510472.502935:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852672768 00000100:00100000:0.0:1788510472.503029:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:0.0:1788510472.503040:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+41:2341:x1875388852672768:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510472.503057:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510472.503084:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65e1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7344e expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.503106:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:0.0:1788510472.503112:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510472.503187:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+40:2341:x1875388852672768:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 149us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510472.503194:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:3.0:1788510472.504590:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852673024 00000100:00100000:3.0:1788510472.504601:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852673024 00000100:00100000:3.0:1788510472.504653:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 42 00000100:00100000:3.0:1788510472.504661:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+40:11406:x1875388852673024:12345-192.168.201.4@tcp:35:cat.0 00000100:00100000:3.0:1788510472.504913:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+41:11406:x1875388852673024:12345-192.168.201.4@tcp:35:cat.0 Request processed in 251us (2099us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788510472.504922:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 42 00000100:00100000:2.0:1788510472.578510:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510472.578647:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852673280 00000100:00100000:0.0:1788510472.578655:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852673280 00000100:00100000:0.0:1788510472.578706:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 154 00000100:00100000:0.0:1788510472.578713:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+41:11412:x1875388852673280:12345-192.168.201.4@tcp:101:dd.0 00010000:00010000:0.0:1788510472.578738:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510472.578742:0:9544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788510472.578781:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed65d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73424 expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.578802:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510472.578807:0:9544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510472.578822:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65e2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73455 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.578924:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.578935:0:9544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65e03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73447 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.578941:0:9544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.578968:0:9544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65e03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73447 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510472.578977:0:9544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65e03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73447 expref: 41 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510472.579008:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861067008:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510472.579116:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa51d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788510472.581540:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861067008:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510472.581570:0:9544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510472.582705:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510472.582799:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852673408 00000100:00100000:1.0:1788510472.582808:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852673408 00010000:00010000:1.0:1788510472.582854:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65e03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73447 expref: 42 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510472.582896:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 65 00000100:00100000:1.0:1788510472.582906:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+42:2341:x1875388852673408:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510472.582922:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510472.582928:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65e03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73447 expref: 42 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.582941:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65e03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73447 expref: 42 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.582987:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65e03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73447 expref: 42 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.583003:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:1.0:1788510472.583008:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.583017:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.583024:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.583062:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510472.583130:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+41:2341:x1875388852673408:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 217us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510472.583137:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 65 00010000:00010000:3.0:1788510472.583954:0:9544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.583966:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510472.584005:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788510472.584472:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65e2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73455 expref: 42 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.584506:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73455 expref: 41 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.584517:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:3.0:1788510472.584520:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788510472.584523:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf200, rc 0) 00000100:00100000:3.0:1788510472.584617:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+41:11412:x1875388852673280:12345-192.168.201.4@tcp:101:dd.0 Request processed in 5903us (6119us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788510472.584626:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 154 00000100:00100000:0.0:1788510472.589006:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510472.589087:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852673664 00000100:00100000:3.0:1788510472.589580:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852673664 00000100:00100000:3.0:1788510472.589689:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 155 00000100:00100000:3.0:1788510472.589700:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+41:11412:x1875388852673664:12345-192.168.201.4@tcp:36:dd.0 00010000:00010000:3.0:1788510472.589973:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.589991:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.590002:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788510472.590046:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788510472.590069:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebf4e63b reply state 00000000b584a8fd transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510472.590092:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788510472.590398:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+44:11412:x1875388852673664:12345-192.168.201.4@tcp:36:dd.0 Request processed in 699us (1402us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788510472.590405:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 155 00000020:00080000:3.0:1788510472.590410:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788510472.595518:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.595536:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.595545:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.595551:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510472.595555:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.595561:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.595578:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:3.0:1788510472.595581:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510472.595586:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510472.595593:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510472.858258:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510472.858537:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852673792 00000100:00100000:2.0:1788510472.858549:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852673792 00000100:00100000:2.0:1788510472.858622:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 156 00000100:00100000:2.0:1788510472.858635:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+43:11426:x1875388852673792:12345-192.168.201.4@tcp:101:stat.0 00010000:00010000:2.0:1788510472.858667:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510472.858693:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7345c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.858804:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65e50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.858821:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65e50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.858837:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65e50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.858855:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.858862:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.858870:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.858958:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.858971:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73455 expref: 44 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.858993:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.859028:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73455 expref: 44 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.859041:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73455 expref: 44 pid: 9544 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510472.859055:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861067136:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510472.859172:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7c70a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788510472.870057:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510472.870183:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861067136:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510472.870216:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510472.870410:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852674048 00000100:00100000:3.0:1788510472.870430:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852674048 00000100:00100000:3.0:1788510472.870528:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 43 00000100:00100000:3.0:1788510472.870539:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+45:5582:x1875388852674048:12345-192.168.201.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788510472.870879:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+46:5582:x1875388852674048:12345-192.168.201.4@tcp:35:ldlm_bl.0 Request processed in 341us (832us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788510472.870887:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 43 00000100:00100000:3.0:1788510472.879888:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510472.880523:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852674176 00000100:00100000:1.0:1788510472.880536:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852674176 00010000:00010000:1.0:1788510472.880586:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73455 expref: 46 pid: 9544 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510472.880636:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 66 00000100:00100000:1.0:1788510472.880647:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+46:2341:x1875388852674176:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510472.880676:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510472.880684:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73455 expref: 46 pid: 9544 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.880726:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73455 expref: 46 pid: 9544 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.880758:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed65e34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73455 expref: 46 pid: 9544 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.880782:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:1.0:1788510472.880789:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.880801:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.880811:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.880851:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510472.880908:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+45:2341:x1875388852674176:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 263us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510472.880916:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 66 00010000:00010000:2.0:1788510472.881068:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881080:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510472.881153:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788510472.881158:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510472.881578:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881595:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881621:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65e50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881628:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65e50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881636:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65e50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881641:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510472.881646:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65e50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881656:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65e50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881740:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:2.0:1788510472.881744:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510472.881749:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65e50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881755:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed65e50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881770:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881776:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881781:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881793:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510472.881796:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881804:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881813:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929aac578b00) 00010000:00010000:2.0:1788510472.881815:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510472.881818:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881823:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed65e57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881870:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed65e49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7345c expref: 45 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881885:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7345c expref: 44 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510472.881892:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:2.0:1788510472.881895:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510472.881897:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76800, rc 0) 00000100:00100000:2.0:1788510472.881942:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+44:11426:x1875388852673792:12345-192.168.201.4@tcp:101:stat.0 Request processed in 23309us (23727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510472.881951:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 156 00000100:00100000:0.0:1788510472.989375:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510472.989605:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852674432 00000100:00100000:1.0:1788510472.989619:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852674432 00000100:00100000:1.0:1788510472.989721:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 157 00000100:00100000:1.0:1788510472.989736:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+44:11432:x1875388852674432:12345-192.168.201.4@tcp:36:truncate.0 00010000:00010000:1.0:1788510472.989834:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510472.989882:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed65e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7345c expref: 44 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.989932:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:1.0:1788510472.989945:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788510472.990328:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.990344:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.990355:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788510472.990427:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1788510472.990452:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9a656d9 reply state 00000000b4c3f620 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510472.990463:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788510472.990694:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+46:11432:x1875388852674432:12345-192.168.201.4@tcp:36:truncate.0 Request processed in 961us (1338us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788510472.990702:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 157 00000020:00080000:1.0:1788510472.990709:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788510472.999362:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.999388:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.999396:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.999403:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510472.999425:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.999434:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.999453:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:1.0:1788510472.999456:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510472.999461:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510472.999467:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510473.228565:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510473.229425:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852674560 00000100:00100000:3.0:1788510473.229438:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852674560 00000100:00100000:3.0:1788510473.229533:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 158 00000100:00100000:3.0:1788510473.229544:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+45:11446:x1875388852674560:12345-192.168.201.4@tcp:101:stat.0 00010000:00010000:3.0:1788510473.229568:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510473.229592:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73463 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229654:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65e73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229669:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229683:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229695:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229701:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229726:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229823:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229832:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229839:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510473.229874:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788510473.229879:0:9544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510473.229902:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229914:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229922:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229929:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65e73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229936:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229942:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510473.229947:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229961:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65e73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229973:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:3.0:1788510473.229976:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510473.229981:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65e73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.229987:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65e73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.230002:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.230008:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65e7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.230013:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.230018:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510473.230020:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.230026:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.230032:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a83eab200) 00010000:00010000:3.0:1788510473.230034:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510473.230036:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65e7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.230050:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.230096:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65e6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73463 expref: 47 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788510473.230379:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788510473.230548:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73463 expref: 46 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.230557:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:3.0:1788510473.230559:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510473.230562:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68000, rc 0) 00000100:00100000:3.0:1788510473.230630:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+46:11446:x1875388852674560:12345-192.168.201.4@tcp:101:stat.0 Request processed in 1088us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510473.230638:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 158 00000100:00100000:0.0:1788510473.397864:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510473.398283:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852674816 00000100:00100000:1.0:1788510473.398296:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852674816 00000100:00100000:1.0:1788510473.398370:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 159 00000100:00100000:1.0:1788510473.398383:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+46:11456:x1875388852674816:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510473.398408:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510473.398437:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7346a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510473.398570:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788510473.398720:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7346a expref: 48 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.398738:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eab100) 00010000:00010000:1.0:1788510473.398742:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788510473.398749:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65e88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7346a expref: 48 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.398785:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033c00, rc 0) 00000100:00100000:1.0:1788510473.398875:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+47:11456:x1875388852674816:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 487us (1026us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788510473.398883:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 159 00000100:00100000:2.0:1788510473.404730:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510473.404986:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852675072 00000100:00100000:3.0:1788510473.404997:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852675072 00000100:00100000:3.0:1788510473.405064:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 44 00000100:00100000:3.0:1788510473.405075:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+47:11456:x1875388852675072:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510473.405398:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+48:11456:x1875388852675072:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 324us (689us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788510473.405406:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 44 00010000:00010000:0.0:1788510473.476448:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510473.491571:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510473.492266:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852675328 00000100:00100000:2.0:1788510473.492282:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852675328 00000100:00100000:2.0:1788510473.492393:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 160 00000100:00100000:2.0:1788510473.492416:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+48:11462:x1875388852675328:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510473.492457:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510473.492496:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65e96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73471 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510473.492649:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510473.492674:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73463 expref: 49 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510473.492687:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510473.492742:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73463 expref: 49 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510473.492767:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73463 expref: 49 pid: 9544 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510473.492791:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861067264:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510473.493368:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7c70a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788510473.496447:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510473.498369:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852675456 00000100:00100000:1.0:1788510473.498388:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852675456 00010000:00010000:1.0:1788510473.498445:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73463 expref: 50 pid: 9544 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510473.498511:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 67 00000100:00100000:1.0:1788510473.498523:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+50:2341:x1875388852675456:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510473.498545:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510473.498554:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73463 expref: 50 pid: 9544 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.498570:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73463 expref: 50 pid: 9544 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.498596:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:1.0:1788510473.498602:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.498612:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.498620:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.498659:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510473.498729:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+50:2341:x1875388852675456:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 209us (2292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510473.498737:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 67 00010000:00010000:0.0:1788510473.502048:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68000/0x3e734462ed65e81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73463 expref: 49 pid: 9544 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510473.502074:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861067264:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510473.502534:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.502545:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.502551:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510473.502594:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788510473.502749:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed65e96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73471 expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.502766:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73471 expref: 49 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.502775:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:0.0:1788510473.502778:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788510473.502782:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77200, rc 0) 00000100:00100000:0.0:1788510473.502918:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+49:11462:x1875388852675328:12345-192.168.201.4@tcp:101:bash.0 Request processed in 10510us (11355us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788510473.502929:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 160 00000100:00100000:3.0:1788510473.511711:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510473.511785:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852675712 00000100:00100000:1.0:1788510473.511796:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852675712 00000100:00100000:1.0:1788510473.511863:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 161 00000100:00100000:1.0:1788510473.511873:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+49:11462:x1875388852675712:12345-192.168.201.4@tcp:36:bash.0 00010000:00010000:1.0:1788510473.512146:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65eab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.512163:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.512174:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788510473.512248:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788510473.512274:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000154b355b reply state 000000006de9996a transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510473.512282:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788510473.517035:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+52:11462:x1875388852675712:12345-192.168.201.4@tcp:36:bash.0 Request processed in 5145us (5316us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788510473.517050:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 161 00000020:00080000:1.0:1788510473.517060:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788510473.526220:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.526273:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65eab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.526280:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.526286:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510473.526291:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.526299:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65eab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.526316:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:1.0:1788510473.526320:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510473.526326:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65eab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.526333:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed65eab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510473.531768:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510473.532345:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852675840 00000100:00100000:3.0:1788510473.532360:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852675840 00000100:00100000:3.0:1788510473.532423:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 162 00000100:00100000:3.0:1788510473.532449:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+51:11462:x1875388852675840:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:3.0:1788510473.532485:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510473.532507:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65eb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73478 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.532587:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65eb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.532603:0:9544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73471 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.532611:0:9544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65eb9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.532647:0:9544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73471 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.532660:0:9544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73471 expref: 52 pid: 5823 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510473.532673:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae949c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861067392:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510473.532761:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510473.543629:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510473.543758:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae949c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861067392:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510473.543788:0:9544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65eb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510473.543873:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852675968 00000100:00100000:1.0:1788510473.543881:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852675968 00010000:00010000:1.0:1788510473.543919:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73471 expref: 53 pid: 5823 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510473.543962:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 68 00000100:00100000:1.0:1788510473.543973:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+53:2340:x1875388852675968:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510473.543992:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510473.544013:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73471 expref: 53 pid: 5823 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.544026:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73471 expref: 53 pid: 5823 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.544050:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65e9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73471 expref: 53 pid: 5823 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.544066:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:1.0:1788510473.544072:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65eb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.544094:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.544109:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65eb9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510473.544149:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510473.544217:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+52:2340:x1875388852675968:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 245us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510473.544267:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 68 00010000:00010000:0.0:1788510473.544392:0:9544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.544399:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510473.544447:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788510473.544452:0:9544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788510473.544485:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.544524:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69000/0x3e734462ed65eb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73478 expref: 52 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.544539:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73478 expref: 51 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.544546:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:0.0:1788510473.544549:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510473.544551:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68a00, rc 0) 00000100:00100000:0.0:1788510473.544578:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+51:11462:x1875388852675840:12345-192.168.201.4@tcp:101:bash.0 Request processed in 12132us (12823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510473.544586:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 162 00000100:00100000:2.0:1788510473.556572:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510473.556665:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852676224 00000100:00100000:3.0:1788510473.556676:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852676224 00000100:00100000:3.0:1788510473.556738:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 45 00000100:00100000:3.0:1788510473.556749:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+51:11462:x1875388852676224:12345-192.168.201.4@tcp:35:bash.0 00000100:00100000:3.0:1788510473.557141:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+52:11462:x1875388852676224:12345-192.168.201.4@tcp:35:bash.0 Request processed in 393us (583us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788510473.557163:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 45 00000100:00100000:3.0:1788510473.673430:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510473.673579:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852676480 00000100:00100000:0.0:1788510473.673592:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852676480 00000100:00100000:0.0:1788510473.673680:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 163 00000100:00100000:0.0:1788510473.673692:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+52:11472:x1875388852676480:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510473.673725:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510473.673767:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7347f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510473.673900:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788510473.674034:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ec0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7347f expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.674050:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eab100) 00010000:00010000:0.0:1788510473.674054:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788510473.674076:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7347f expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.674105:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf600, rc 0) 00000100:00100000:0.0:1788510473.674169:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+53:11472:x1875388852676480:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 480us (756us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788510473.674178:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 163 00000100:00100000:2.0:1788510473.690211:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510473.690596:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852676608 00000100:00100000:0.0:1788510473.690609:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852676608 00000100:00100000:0.0:1788510473.690699:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 164 00000100:00100000:0.0:1788510473.690711:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+53:11472:x1875388852676608:12345-192.168.201.4@tcp:34:lfs.0 00010000:00010000:0.0:1788510473.690833:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ece lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.690859:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.690875:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.690895:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65ed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.690902:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.690908:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691033:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65edc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691056:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691064:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510473.691364:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691383:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691390:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ece lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691398:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691405:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510473.691410:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691419:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ece lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691434:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510473.691437:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510473.691443:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ece lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691451:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ece lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691494:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691501:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691507:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691513:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafa00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510473.691517:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691524:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691532:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a8b8f5800) 00010000:00010000:0.0:1788510473.691535:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510473.691538:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65ed5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691544:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65ed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691562:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691568:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65edc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691575:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691586:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510473.691590:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691596:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65edc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691604:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:0.0:1788510473.691607:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510473.691610:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65edc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.691616:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65edc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510473.691890:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+53:11472:x1875388852676608:12345-192.168.201.4@tcp:34:lfs.0 Request processed in 1177us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510473.691899:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 164 00000100:00100000:2.0:1788510473.695536:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510473.695640:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852676864 00000100:00100000:3.0:1788510473.695655:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852676864 00000100:00100000:3.0:1788510473.695727:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 46 00000100:00100000:3.0:1788510473.695740:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+53:11472:x1875388852676864:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510473.696456:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:11472:x1875388852676864:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 713us (926us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788510473.696477:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 46 00000100:00100000:1.0:1788510473.776203:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510473.776907:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852677120 00000100:00100000:0.0:1788510473.776917:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852677120 00000100:00100000:0.0:1788510473.776978:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 165 00000100:00100000:0.0:1788510473.776989:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:11475:x1875388852677120:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510473.777013:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510473.777033:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65ee3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73486 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777136:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65eea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777160:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65eea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777172:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65eea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777187:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777431:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777440:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777570:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65ef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777580:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777587:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510473.777597:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788510473.777704:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65eea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777712:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65eea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777719:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65eea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777734:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafa00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510473.777739:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65eea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777746:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65eea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777758:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510473.777762:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510473.777766:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65eea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777773:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65eea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777788:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777793:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ef1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777799:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777804:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510473.777806:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777812:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777829:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a8b8f5800) 00010000:00010000:0.0:1788510473.777832:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510473.777835:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ef1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.777841:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed65ef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.778051:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed65ee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73486 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.778067:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73486 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510473.778135:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:0.0:1788510473.778137:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510473.778140:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf800, rc 0) 00000100:00100000:0.0:1788510473.778211:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:11475:x1875388852677120:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 1223us (2017us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788510473.778219:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 165 00000100:00100000:2.0:1788510473.786988:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510473.787358:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852677248 00000100:00100000:3.0:1788510473.787370:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852677248 00000100:00100000:3.0:1788510473.787437:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 166 00000100:00100000:3.0:1788510473.787450:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:11475:x1875388852677248:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:3.0:1788510473.787535:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.787556:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.787570:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.787605:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.787613:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.787643:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.787650:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510473.787655:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.787681:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.787695:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:3.0:1788510473.787699:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788510473.787704:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.787711:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510473.787795:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:11475:x1875388852677248:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 347us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510473.787803:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 166 00000100:00100000:2.0:1788510473.788147:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510473.788549:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852677376 00000100:00100000:3.0:1788510473.788555:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852677376 00000100:00100000:3.0:1788510473.788611:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:3.0:1788510473.788621:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:2343:x1875388852677376:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510473.788639:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510473.788724:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed65ef8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73486 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510473.788757:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:3.0:1788510473.788761:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510473.788795:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:2343:x1875388852677376:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 175us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510473.788802:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:2.0:1788510473.802980:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510473.803881:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852677632 00000100:00100000:1.0:1788510473.803894:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852677632 00000100:00100000:1.0:1788510473.803952:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 47 00000100:00100000:1.0:1788510473.803961:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:11475:x1875388852677632:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:1.0:1788510473.804175:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:11475:x1875388852677632:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 215us (1204us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788510473.804192:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 47 00000004:00080000:3.0:1788510473.925412:0:6725:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331744185119ns, next at 332744182062ns, rc = 0 00000100:00100000:3.0:1788510473.926003:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861067520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788510473.926077:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510473.926209:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861067520 00000100:00100000:1.0:1788510473.926218:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861067520 00000100:00100000:1.0:1788510473.926299:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788510473.926310:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875388861067520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788510473.926345:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510473.926399:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875388861067520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510473.926568:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861067520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510473.926991:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000001:00080000:2.0:1788510474.011495:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:2.0:1788510474.011545:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:2.0:1788510474.011580:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788510474.011598:0:5843:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff929a88c79a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788510474.011603:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929aaea38800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff929a88c79900 00000020:00080000:2.0:1788510474.011606:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929aaea38c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff929ab506d400 00000020:00080000:2.0:1788510474.011987:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1788510474.012358:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaed52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861067648:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788510474.012427:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510474.012795:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861067648 00000100:00100000:0.0:1788510474.012804:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861067648 00000100:00100000:0.0:1788510474.012933:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788510474.012945:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861067648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788510474.012975:0:8183:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1788510474.013010:0:8183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9a8107, atime: 0x6a9a8108, ctime: 0x6a9a8107, blocks: 0x1 00010000:00010000:0.0:1788510474.013018:0:8183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000beb73b/0x3e734462ed65f0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510474.013047:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1788510474.013052:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510474.013059:0:8183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000beb73b/0x3e734462ed65f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510474.014018:0:8183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000beb73b/0x3e734462ed65f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510474.014036:0:8183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000beb73b/0x3e734462ed65f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510474.014044:0:8183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000beb73b/0x3e734462ed65f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788510474.014320:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788510474.014391:0:8183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788510474.015093:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3290:x1875388861067648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2144us (2660us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788510474.015106:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788510474.016142:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929aaed52d80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788510474.016154:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaed52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861067648:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1788510474.020628:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788510474.020660:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510474.020671:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000beb73b/0x3e734462ed65f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.020698:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510474.020704:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000beb73b/0x3e734462ed65f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.020717:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000beb73b/0x3e734462ed65f0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.020740:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000beb73b/0x3e734462ed65f0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.020749:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000beb73b/0x3e734462ed65f0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.020790:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510474.020792:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510474.020793:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510474.087586:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510474.087682:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852677888 00000100:00100000:1.0:1788510474.087692:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852677888 00000100:00100000:1.0:1788510474.087754:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 167 00000100:00100000:1.0:1788510474.087765:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+16:11493:x1875388852677888:12345-192.168.201.4@tcp:101:cat.0 00010000:00010000:1.0:1788510474.087798:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510474.087819:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7348d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510474.087925:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65f1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510474.087940:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510474.087950:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510474.087961:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788510474.088193:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7348d expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510474.088279:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7348d expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510474.088289:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:1.0:1788510474.088292:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788510474.088295:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032600, rc 0) 00000100:00100000:1.0:1788510474.088362:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11493:x1875388852677888:12345-192.168.201.4@tcp:101:cat.0 Request processed in 599us (787us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788510474.088368:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 167 00000100:00100000:0.0:1788510474.132576:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510474.132699:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852678016 00000100:00100000:3.0:1788510474.132712:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852678016 00000100:00100000:3.0:1788510474.132838:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 168 00000100:00100000:3.0:1788510474.132850:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11494:x1875388852678016:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:3.0:1788510474.132888:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510474.132910:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73494 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.132977:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.133005:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.133017:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510474.133063:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788510474.133067:0:9544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510474.133084:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.133315:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73494 expref: 20 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.133335:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73494 expref: 19 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.133345:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:3.0:1788510474.133348:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788510474.133352:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68400, rc 0) 00000100:00100000:3.0:1788510474.133503:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11494:x1875388852678016:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 607us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510474.133511:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 168 00000100:00100000:3.0:1788510474.143773:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510474.143961:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852678400 00000100:00100000:1.0:1788510474.143973:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852678400 00000100:00100000:1.0:1788510474.144057:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 48 00000100:00100000:1.0:1788510474.144070:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11494:x1875388852678400:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:1.0:1788510474.144717:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11494:x1875388852678400:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 648us (953us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788510474.144820:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 48 00000100:00100000:0.0:1788510474.149029:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510474.149523:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852678528 00000100:00100000:2.0:1788510474.149537:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852678528 00000100:00100000:2.0:1788510474.149669:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:2.0:1788510474.149692:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11494:x1875388852678528:12345-192.168.201.4@tcp:103:lfs.0 00010000:00010000:2.0:1788510474.149718:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788510474.149753:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68a00/0x3e734462ed65eb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73478 expref: 20 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.149784:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed65f1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7348d expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.149798:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65dc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73439 expref: 18 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.149812:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929aac578d00) 00010000:00010000:2.0:1788510474.149825:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510474.150009:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:11494:x1875388852678528:12345-192.168.201.4@tcp:103:lfs.0 Request processed in 329us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510474.150017:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:0.0:1788510474.157101:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510474.157320:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852678656 00000100:00100000:1.0:1788510474.157332:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852678656 00000100:00100000:1.0:1788510474.157403:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 169 00000100:00100000:1.0:1788510474.157415:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:11494:x1875388852678656:12345-192.168.201.4@tcp:58:lfs.0 00010000:00010000:1.0:1788510474.157568:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f37 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510474.157586:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510474.157611:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788510474.157987:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788510474.158084:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:11494:x1875388852678656:12345-192.168.201.4@tcp:58:lfs.0 Request processed in 671us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510474.158600:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 169 00000100:00100000:0.0:1788510474.201427:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510474.201829:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852678784 00000100:00100000:2.0:1788510474.201839:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852678784 00000100:00100000:2.0:1788510474.201895:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 170 00000100:00100000:2.0:1788510474.201906:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:11496:x1875388852678784:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510474.201938:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510474.201957:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65f3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7349b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202024:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65f45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202049:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65f45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202214:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65f45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202272:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65f4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202281:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202287:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202756:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202766:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202775:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510474.202818:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788510474.202828:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510474.202852:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202865:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202875:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65f45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202881:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65f45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202888:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65f45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202894:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510474.202900:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65f45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202908:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65f45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202921:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:2.0:1788510474.202924:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510474.202930:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65f45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202937:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed65f45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202951:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202966:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65f4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202971:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202975:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510474.202978:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202984:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65f4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.202992:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929aac578d00) 00010000:00010000:2.0:1788510474.202994:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510474.202997:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65f4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.203003:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed65f4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.203037:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed65f3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7349b expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.203435:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7349b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510474.203442:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a82b92800) 00010000:00010000:2.0:1788510474.203445:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510474.203463:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76c00, rc 0) 00000100:00100000:2.0:1788510474.203539:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11496:x1875388852678784:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 1635us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510474.203547:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 170 00010000:00010000:0.0:1788510474.500479:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788510474.948729:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788510474.948744:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788510474.948832:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788510474.948857:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788510474.953028:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf3cc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861067776:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788510474.953520:0:11661:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b33540 going to sleep for 11 seconds 00000100:00100000:1.0:1788510474.961764:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf3cc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861067776:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788510474.965940:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510474.966014:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852678912 00000100:00100000:0.0:1788510474.966027:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852678912 00000100:00100000:0.0:1788510474.966099:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 171 00000100:00100000:0.0:1788510474.966122:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11507:x1875388852678912:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788510474.966157:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788510474.966273:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11507:x1875388852678912:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 154us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510474.966281:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 171 00000100:00100000:0.0:1788510474.978610:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510474.978767:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852679040 00000100:00100000:3.0:1788510474.978781:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852679040 00000100:00100000:3.0:1788510474.978984:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 172 00000100:00100000:3.0:1788510474.978996:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11507:x1875388852679040:12345-192.168.201.4@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788510474.979122:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f5a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979157:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979173:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979301:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65f61 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979311:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65f61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979319:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65f61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979354:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979364:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979372:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510474.979431:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788510474.979447:0:9544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510474.979466:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979480:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979496:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f5a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979504:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979512:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510474.979518:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979528:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f5a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979543:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:3.0:1788510474.979547:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510474.979554:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979981:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed65f5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.979999:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65f61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980006:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65f61 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980014:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65f61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980019:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510474.980029:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65f61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980037:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65f61 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980046:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff929a83eab200) 00010000:00010000:3.0:1788510474.980049:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510474.980052:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65f61 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980058:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65f61 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980075:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980081:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980087:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980092:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510474.980095:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980102:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980110:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a82b92800) 00010000:00010000:3.0:1788510474.980112:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510474.980120:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.980127:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510474.980656:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11507:x1875388852679040:12345-192.168.201.4@tcp:34:lhsmtool_posix.0 Request processed in 1656us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510474.980668:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 172 00000100:00100000:1.0:1788510474.985882:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510474.986020:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852679296 00000100:00100000:3.0:1788510474.986031:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852679296 00000100:00100000:3.0:1788510474.986115:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 173 00000100:00100000:3.0:1788510474.986126:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11507:x1875388852679296:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510474.986154:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510474.986178:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65f6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734a2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.986352:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.986371:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.986387:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510474.986400:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788510474.986985:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.986996:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.987018:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.987024:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510474.987030:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.987039:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.987052:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a82b92800) 00010000:00010000:3.0:1788510474.987055:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788510474.987060:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.987068:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.987191:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65f6f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734a2 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.987203:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:3.0:1788510474.987206:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788510474.987210:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65f6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734a2 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510474.987447:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68c00, rc 0) 00000100:00100000:3.0:1788510474.987540:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11507:x1875388852679296:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 1415us (1671us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788510474.987575:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 173 00000100:00100000:0.0:1788510475.000562:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510475.000654:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852679424 00000100:00100000:2.0:1788510475.000666:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852679424 00000100:00100000:2.0:1788510475.000749:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 174 00000100:00100000:2.0:1788510475.000759:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11507:x1875388852679424:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788510475.000803:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788510475.000937:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11507:x1875388852679424:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 179us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510475.000946:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 174 00000100:00080000:0.0:1788510475.001839:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510475.013426:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510475.013518:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852679680 00000100:00100000:3.0:1788510475.013531:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852679680 00000100:00100000:3.0:1788510475.013600:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 175 00000100:00100000:3.0:1788510475.013613:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11507:x1875388852679680:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510475.013637:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510475.013641:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788510475.013680:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65f30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73494 expref: 19 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.013702:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:3.0:1788510475.013707:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788510475.013720:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65f84 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734a9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788510475.014611:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788510475.014846:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.014862:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.014872:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.014924:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65f84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734a9 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.014950:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734a9 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.014958:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eab200) 00010000:00010000:3.0:1788510475.014961:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510475.014963:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69c00, rc 0) 00000100:00100000:3.0:1788510475.015035:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11507:x1875388852679680:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 1425us (1633us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788510475.015043:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 175 00000100:00100000:1.0:1788510475.023826:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510475.023906:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852679936 00000100:00100000:0.0:1788510475.023916:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852679936 00000100:00100000:0.0:1788510475.023973:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 176 00000100:00100000:0.0:1788510475.023983:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11507:x1875388852679936:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788510475.024041:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510475.024088:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69c00/0x3e734462ed65f8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734a9 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.024108:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eab200) 00010000:00010000:0.0:1788510475.024120:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510475.024142:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65f99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.024156:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65f99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.024166:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65f99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.024181:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1420a7b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.024202:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1420a7b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.024208:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1420a7b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025397:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65f99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025410:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65f99 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025418:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65f99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025424:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510475.025428:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65f99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025453:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65f99 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025466:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510475.025469:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510475.025475:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65f99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025482:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65f99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025493:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1420a7b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025506:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1420a7b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025512:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1420a7b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025517:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510475.025520:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1420a7b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025527:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fa0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1420a7b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025536:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1420a7b2 (ffff929a8b8f5600) 00010000:00010000:0.0:1788510475.025539:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510475.025541:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fa0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1420a7b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.025547:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1420a7b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510475.025643:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11507:x1875388852679936:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 1658us (1827us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788510475.025651:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 176 00000100:00100000:0.0:1788510475.027944:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510475.028027:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852680064 00000100:00100000:3.0:1788510475.028036:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852680064 00000100:00100000:3.0:1788510475.028339:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 177 00000100:00100000:3.0:1788510475.028351:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11507:x1875388852680064:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510475.028373:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510475.028398:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fa7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734b0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.028434:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65fae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.028460:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.028473:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.028578:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b0 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.028601:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65fae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b0 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.028609:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eabb00) 00010000:00010000:3.0:1788510475.028612:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788510475.028616:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68400, rc 0) 00000100:00100000:3.0:1788510475.028677:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11507:x1875388852680064:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 329us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510475.028685:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 177 00000100:00100000:1.0:1788510475.040768:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510475.040881:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852680320 00000100:00100000:3.0:1788510475.040891:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852680320 00000100:00100000:3.0:1788510475.040948:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 178 00000100:00100000:3.0:1788510475.040959:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11507:x1875388852680320:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788510475.041048:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65fb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.041296:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.041313:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788510475.041632:0:9544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788510475.041642:0:9544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332860418934ns, next at 333860416549ns, rc = 0 00000004:00010000:3.0:1788510475.041720:0:9544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075739f85 reply state 0000000002b6c6ed transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510475.041749:0:9544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788510475.041868:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:11507:x1875388852680320:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 909us (1109us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788510475.041878:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 178 00010000:00010000:3.0:1788510475.043525:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.043545:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.043554:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.043561:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510475.043566:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.043573:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65fb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.043591:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eabb00) 00010000:00010000:3.0:1788510475.043594:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788510475.043599:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65fb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.043606:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69600/0x3e734462ed65fb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510475.052456:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510475.053913:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852680448 00000100:00100000:0.0:1788510475.053925:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852680448 00000100:00100000:0.0:1788510475.053986:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 179 00000100:00100000:0.0:1788510475.053998:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:11507:x1875388852680448:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788510475.054030:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510475.054052:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65fbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734b7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.054131:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65fbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b7 expref: 22 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.054147:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65fbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b7 expref: 22 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.054167:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eabb00) 00010000:00010000:0.0:1788510475.054170:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788510475.054173:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafa00, rc 0) 00000100:00100000:0.0:1788510475.054249:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:11507:x1875388852680448:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 253us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510475.054256:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 179 00000100:00100000:1.0:1788510475.062946:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510475.064164:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852680576 00000100:00100000:2.0:1788510475.064176:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852680576 00000100:00080000:0.0:1788510475.064263:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788510475.064896:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 51 00000100:00100000:2.0:1788510475.064912:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852680576:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788510475.065275:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852680576:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 Request processed in 366us (2337us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788510475.065283:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 51 00000100:00100000:1.0:1788510475.076168:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510475.076988:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852680832 00000100:00100000:3.0:1788510475.077007:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852680832 00000100:00100000:3.0:1788510475.080207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00100000:3.0:1788510475.080260:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:11507:x1875388852680832:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788510475.080598:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:11507:x1875388852680832:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 375us (4441us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788510475.080606:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00100000:1.0:1788510475.093764:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510475.094716:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852681088 00000100:00100000:0.0:1788510475.094731:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852681088 00000100:00100000:0.0:1788510475.094808:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 180 00000100:00100000:0.0:1788510475.094821:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:11507:x1875388852681088:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788510475.094951:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:11507:x1875388852681088:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 132us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510475.094959:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 180 00000100:00100000:2.0:1788510475.099409:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510475.099487:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852681216 00000100:00100000:0.0:1788510475.099498:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852681216 00000100:00100000:0.0:1788510475.099563:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 181 00000100:00100000:0.0:1788510475.099582:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:11507:x1875388852681216:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788510475.099607:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510475.099628:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734be expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.099699:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65fca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.099714:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.099726:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510475.099763:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788510475.099781:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.099806:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed65fc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734be expref: 25 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.099820:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734be expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.099829:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eabb00) 00010000:00010000:0.0:1788510475.099831:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788510475.099836:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf400, rc 0) 00000100:00100000:0.0:1788510475.099894:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:11507:x1875388852681216:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 314us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510475.099910:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 181 00000100:00100000:2.0:1788510475.105091:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510475.105177:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852681344 00000100:00100000:3.0:1788510475.105188:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852681344 00000100:00100000:3.0:1788510475.105265:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 52 00000100:00100000:3.0:1788510475.105277:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2343:x1875388852681344:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510475.105293:0:12047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510475.105313:0:12047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed65fd1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734c5 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788510475.105341:0:12047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a810a, blocks: 0x1 00010000:00010000:3.0:1788510475.105359:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1788510475.105364:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788510475.105373:0:12047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed65fd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734c5 expref: 8 pid: 12047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.105393:0:12047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed65fd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734c5 expref: 8 pid: 12047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.105405:0:12047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69600, rc 0) 00000100:00100000:3.0:1788510475.105478:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2343:x1875388852681344:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 202us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510475.105495:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 52 00000100:00100000:0.0:1788510475.112451:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510475.115460:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852681600 00000100:00100000:1.0:1788510475.115480:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852681600 00000100:00100000:1.0:1788510475.119303:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 182 00000100:00100000:1.0:1788510475.119330:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:11507:x1875388852681600:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788510475.119483:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:11507:x1875388852681600:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 165us (7051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510475.119493:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 182 00000100:00100000:2.0:1788510475.125405:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510475.135371:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852681728 00000100:00100000:0.0:1788510475.135389:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852681728 00000100:00100000:0.0:1788510475.136641:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 53 00000100:00100000:0.0:1788510475.136657:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:11507:x1875388852681728:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788510475.136678:0:6667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510475.136700:0:6667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734cc expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.136740:0:6667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed65fd1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734c5 expref: 9 pid: 12047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.136751:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510475.136756:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510475.136762:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 9 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.136802:0:6667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed65fd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734c5 expref: 9 pid: 12047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.136816:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed65fd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734c5 expref: 9 pid: 12047 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510475.136832:0:6667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6667:1875388861067904:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510475.137090:0:6667:0:(client.c:2716:ptlrpc_set_wait()) set ffff92998183fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510475.141591:0:6667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6667:1875388861067904:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510475.141628:0:6667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 9 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.141648:0:6667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf000, rc 0) 00000100:00100000:3.0:1788510475.141715:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:11507:x1875388852681728:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 5062us (16319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510475.141724:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 53 00000100:00100000:0.0:1788510475.147925:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510475.148177:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852681856 00000100:00100000:2.0:1788510475.148192:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852681856 00010000:00010000:2.0:1788510475.148311:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed65fd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734c5 expref: 9 pid: 12047 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510475.148381:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 69 00000100:00100000:2.0:1788510475.148394:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2340:x1875388852681856:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510475.148413:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510475.148451:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed65fd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734c5 expref: 9 pid: 12047 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.148466:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed65fd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734c5 expref: 9 pid: 12047 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.148494:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed65fd1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734c5 expref: 9 pid: 12047 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.148508:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510475.148512:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510475.148520:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.148530:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.148589:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510475.148606:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeca1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1875388861068032:192.168.201.4@tcp:105: 00000100:00100000:2.0:1788510475.149678:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9209cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510475.160818:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510475.160953:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeca1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1875388861068032:192.168.201.4@tcp:105: 00010000:00010000:3.0:1788510475.160979:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510475.161033:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852681856:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 12642us (13124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510475.161045:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 69 00000100:00100000:0.0:1788510475.161997:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852681984 00000100:00100000:0.0:1788510475.162011:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852681984 00002000:00100000:0.0:1788510475.164253:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff929aae94b800 x1875388852681984/t0(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:46/0 lens 504/0 e 0 to 0 dl 1788510486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788510475.164276:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aae94b800 with x1875388852681984 ext(0->8) 00002000:00010000:0.0:1788510475.164288:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929aae94b800 00000100:00100000:0.0:1788510475.164349:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:0.0:1788510475.164370:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2341:x1875388852681984:12345-192.168.201.4@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788510475.164993:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:2341:x1875388852681984:12345-192.168.201.4@tcp:4:lhsmtool_posix.0 Request processed in 630us (4182us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788510475.165003:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 4 00002000:00100000:0.0:1788510475.165011:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff929aae94b800 x1875388852681984/t4294967314(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:46/0 lens 504/448 e 0 to 0 dl 1788510486 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788510475.165021:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aae94b800 with x1875388852681984 ext(0->8) 00002000:00010000:0.0:1788510475.165026:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929aae94b800 00000100:00100000:0.0:1788510475.170490:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510475.170541:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852682112 00000100:00100000:0.0:1788510475.170554:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852682112 00000100:00100000:0.0:1788510475.170626:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 183 00000100:00100000:0.0:1788510475.170637:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:11507:x1875388852682112:12345-192.168.201.4@tcp:44:lhsmtool_posix.0 00000040:00080000:0.0:1788510475.211565:0:12488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788510475.211578:0:12488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788510475.211622:0:12488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788510475.211635:0:12488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788510475.215702:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:2.0:1788510475.215719:0:5843:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1788510475.215730:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1788510475.215740:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:2.0:1788510475.215919:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788510475.215945:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788510475.215954:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788510475.216070:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11507:x1875388852682112:12345-192.168.201.4@tcp:44:lhsmtool_posix.0 Request processed in 45427us (45589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510475.216082:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 183 00000100:00100000:2.0:1788510475.217478:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788510475.217501:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861068160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788510475.217569:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510475.217614:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861068160 00000100:00100000:2.0:1788510475.217622:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861068160 00000100:00100000:2.0:1788510475.217677:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788510475.217686:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861068160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788510475.217854:0:6670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788510475.217858:0:6670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788510475 00002000:00010000:2.0:1788510475.217860:0:6670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788510475.217862:0:6670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788510474 -> 1788510475 00002000:00010000:2.0:1788510475.217865:0:6670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788510475.217903:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861068160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (334us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788510475.217911:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1788510475.217956:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929aaeca2d80/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788510475.217963:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861068160:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788510475.217968:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788510475.220982:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510475.221491:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852682240 00000100:00100000:3.0:1788510475.221502:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852682240 00000100:00100000:3.0:1788510475.221648:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 55 00000100:00100000:3.0:1788510475.221660:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:2340:x1875388852682240:12345-192.168.201.4@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788510475.291654:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:0.0:1788510475.291678:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1788510475.291841:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852682240:12345-192.168.201.4@tcp:16:lhsmtool_posix.0 Request processed in 70177us (70866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510475.291853:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 55 00000100:00100000:0.0:1788510475.295669:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510475.295813:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852682496 00000100:00100000:1.0:1788510475.295824:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852682496 00000100:00100000:1.0:1788510475.295886:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 184 00000100:00100000:1.0:1788510475.295898:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11507:x1875388852682496:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788510475.295967:0:9544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510475.295999:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed65fca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734be expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.296019:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eabb00) 00010000:00010000:1.0:1788510475.296024:0:9544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788510475.296055:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65fdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.296078:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65fdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.296089:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65fdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788510475.296421:0:9544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c037c69 reply state 000000003b33d706 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65fdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510475.296454:0:9544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788510475.296567:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11507:x1875388852682496:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 670us (909us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788510475.296575:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 184 00010000:00010000:3.0:1788510475.300482:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65fdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.300500:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65fdf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.300509:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65fdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.300529:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510475.300534:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65fdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.300542:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65fdf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.300558:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eabb00) 00010000:00010000:3.0:1788510475.300561:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510475.300566:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65fdf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.300572:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed65fdf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510475.300720:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510475.300787:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852682624 00000100:00100000:3.0:1788510475.300798:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852682624 00000100:00100000:3.0:1788510475.300861:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 56 00000100:00100000:3.0:1788510475.300875:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852682624:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788510475.301517:0:6667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788510475.301521:0:6667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788510475 -> 1788510473 00002000:00010000:0.0:1788510475.301524:0:6667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788510472 00002000:00010000:0.0:1788510475.301526:0:6667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788510475 -> 1788510473 00002000:00010000:0.0:1788510475.301529:0:6667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788510475.301598:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2341:x1875388852682624:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 Request processed in 725us (885us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788510475.301607:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 56 00000100:00100000:2.0:1788510475.305626:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510475.305739:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852682880 00000100:00100000:3.0:1788510475.305752:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852682880 00000100:00100000:3.0:1788510475.305833:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 185 00000100:00100000:3.0:1788510475.305845:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11507:x1875388852682880:12345-192.168.201.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788510475.305942:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.305964:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65fae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b0 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.305987:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.306032:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65fae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b0 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.306050:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65fae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b0 expref: 18 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510475.306343:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae948e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861068288:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510475.306452:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aa1701d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788510475.309638:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae948e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861068288:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510475.309671:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510475.311018:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510475.311133:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852683008 00000100:00100000:3.0:1788510475.311152:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852683008 00010000:00010000:3.0:1788510475.311188:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65fae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b0 expref: 19 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510475.311465:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 70 00000100:00100000:2.0:1788510475.311476:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:2342:x1875388852683008:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510475.311492:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510475.311500:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65fae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b0 expref: 19 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.311513:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65fae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b0 expref: 19 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.311611:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed65fae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b0 expref: 19 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.311627:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eabb00) 00010000:00010000:2.0:1788510475.311633:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.311642:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.311651:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.311679:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788510475.311716:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.311724:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510475.311730:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:2342:x1875388852683008:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 256us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510475.311747:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 70 00010000:00010000:3.0:1788510475.311751:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.311757:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.311763:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.311780:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510475.311785:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.311794:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.311804:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eabb00) 00010000:00010000:3.0:1788510475.311807:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788510475.311812:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.311819:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed65fe6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510475.311860:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:11507:x1875388852682880:12345-192.168.201.4@tcp:55:lhsmtool_posix.0 Request processed in 6017us (6246us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788510475.311868:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 185 00000100:00100000:2.0:1788510475.322828:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510475.323167:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852683136 00000100:00100000:0.0:1788510475.323180:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852683136 00000100:00100000:1.0:1788510475.323277:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 57 00000100:00100000:1.0:1788510475.323294:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2341:x1875388852683136:12345-192.168.201.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788510475.323340:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.323361:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.323370:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788510475.323374:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788510475.323379:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.323417:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.323443:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 8 pid: 6667 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510475.323460:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98432300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1875388861068416:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510475.323560:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b33840 going to sleep for 11 seconds 00000100:00100000:0.0:1788510475.333608:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510475.333844:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98432300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1875388861068416:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510475.333876:0:6669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510475.333960:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852683264 00000100:00100000:3.0:1788510475.333968:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852683264 00010000:00010000:3.0:1788510475.334005:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 9 pid: 6667 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510475.334048:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 71 00000100:00100000:3.0:1788510475.334058:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2340:x1875388852683264:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510475.334087:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510475.334116:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 9 pid: 6667 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.334141:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 9 pid: 6667 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.334164:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031427651/0x3e734462ed65fd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734cc expref: 9 pid: 6667 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.334176:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788510475.334181:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788510475.334186:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.334196:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.334245:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510475.334304:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852683264:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 247us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510475.334311:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 71 00010000:00010000:1.0:1788510475.334375:0:6669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.334384:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.334407:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.334416:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.334424:0:6669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.334441:0:6669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032a00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510475.334446:0:6669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.334454:0:6669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.334465:0:6669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.334480:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0f6ff8b/0x3e734462ed65fed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510475.334537:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852683136:12345-192.168.201.4@tcp:1:lhsmtool_posix.0 Request processed in 11248us (11717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510475.334545:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 57 00000100:00100000:0.0:1788510475.348554:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510475.348632:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852683520 00000100:00100000:1.0:1788510475.348643:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852683520 00000100:00100000:1.0:1788510475.348697:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 186 00000100:00100000:1.0:1788510475.348710:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+17:11507:x1875388852683520:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788510475.348819:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65ff4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.348842:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.348856:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.349099:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.349112:0:9544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65fbc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b7 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.349121:0:9544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.349167:0:9544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65fbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b7 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510475.349182:0:9544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65fbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b7 expref: 18 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510475.349197:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a98432300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861068544:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510475.349340:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b33840 going to sleep for 11 seconds 00000100:00100000:2.0:1788510475.361933:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510475.361969:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a98432300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861068544:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510475.362006:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852683648 00010000:00010000:0.0:1788510475.362009:0:9544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510475.362015:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852683648 00010000:00010000:3.0:1788510475.362064:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65fbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b7 expref: 19 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510475.362109:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 72 00000100:00100000:3.0:1788510475.362120:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:2340:x1875388852683648:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510475.362151:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510475.362160:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65fbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b7 expref: 19 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.362174:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65fbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b7 expref: 19 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.362203:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed65fbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734b7 expref: 19 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.362251:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eabb00) 00010000:00010000:3.0:1788510475.362257:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.362269:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.362278:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.362308:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510475.362339:0:9544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.362347:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510475.362372:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:2340:x1875388852683648:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 254us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510475.362381:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 72 00000001:00080000:0.0:1788510475.362580:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788510475.362741:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788510475.362801:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788510475.362895:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9544:1875388861068672:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788510475.362941:0:9544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510475.362974:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff92998183f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788510475.364192:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861068672 00000100:00100000:3.0:1788510475.364204:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861068672 00000100:00100000:3.0:1788510475.364484:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788510475.364495:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9544:x1875388861068672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788510475.364599:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9544:x1875388861068672:12345-0@lo:1000:mdt00_003.0 Request processed in 107us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510475.364618:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788510475.364625:0:9544:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788510475.364632:0:9544:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff929aaeca2d80, transno 4294967315 00000100:00100000:0.0:1788510475.364645:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9544:1875388861068672:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788510475.365141:0:9544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788510475.365246:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9544:1875388861068800:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788510475.365289:0:9544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510475.365317:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a83095300 going to sleep for 11 seconds 00000100:00100000:3.0:1788510475.365873:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861068800 00000100:00100000:3.0:1788510475.365881:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861068800 00000100:00100000:3.0:1788510475.365926:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788510475.365935:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9544:x1875388861068800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788510475.366152:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9544:x1875388861068800:12345-0@lo:1000:mdt00_003.0 Request processed in 217us (862us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788510475.366158:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788510475.366776:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9544:1875388861068800:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788510475.366822:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366842:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366851:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366857:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510475.366862:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366870:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366893:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eabb00) 00010000:00010000:0.0:1788510475.366896:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788510475.366901:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366908:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed65ffb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366935:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366940:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f37 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366945:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366949:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510475.366952:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366957:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f37 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366965:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a82b92800) 00010000:00010000:0.0:1788510475.366967:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788510475.366970:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f37 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.366974:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed65f37 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.367004:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.367017:0:9544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7349b expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.367024:0:9544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.367054:0:9544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7349b expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.367067:0:9544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7349b expref: 21 pid: 5823 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510475.367078:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a89045180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861068928:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510475.369693:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a83095300 going to sleep for 11 seconds 00000100:00100000:2.0:1788510475.376525:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510475.376586:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852683904 00000100:00100000:0.0:1788510475.376595:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852683904 00000100:00100000:0.0:1788510475.376659:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 97 00000100:00100000:2.0:1788510475.376669:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510475.376670:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852683904:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510475.376690:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852683776 00000100:00100000:2.0:1788510475.376693:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852683776 00000100:00100000:2.0:1788510475.376718:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 298 00000100:00100000:2.0:1788510475.376724:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852683776:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510475.376741:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852683904:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 74us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510475.376747:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852683776:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 24us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510475.376748:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 97 00000100:00080000:0.0:1788510475.376770:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510475.376806:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 298 00000100:00100000:2.0:1788510475.376859:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510475.377238:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852684032 00000100:00100000:0.0:1788510475.377244:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852684032 00000100:00100000:0.0:1788510475.377307:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 165 00000100:00100000:0.0:1788510475.377314:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852684032:12345-192.168.201.4@tcp:400:kworker.0 00000100:00080000:2.0:1788510475.377315:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510475.377360:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2341:x1875388852684032:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 46us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510475.377367:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 165 00000100:00100000:0.0:1788510475.382825:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a89045180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861068928:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510475.382867:0:9544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510475.384844:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510475.385118:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852684160 00000100:00100000:2.0:1788510475.385128:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852684160 00010000:00010000:2.0:1788510475.385164:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7349b expref: 22 pid: 5823 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510475.385205:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 73 00000100:00100000:2.0:1788510475.385214:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:2340:x1875388852684160:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510475.385250:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510475.385258:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7349b expref: 22 pid: 5823 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.385272:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7349b expref: 22 pid: 5823 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.385308:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed65f53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7349b expref: 22 pid: 5823 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.385322:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a82b92800) 00010000:00010000:2.0:1788510475.385328:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.385337:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.385344:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.385367:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510475.385414:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:2340:x1875388852684160:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 201us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510475.385422:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 73 00010000:00010000:0.0:1788510475.390131:0:9544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390151:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390166:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390172:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390180:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390186:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510475.390190:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390198:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390256:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a82b92800) 00010000:00010000:0.0:1788510475.390261:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510475.390267:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390275:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66002 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390294:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390300:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65ff4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390306:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390310:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510475.390313:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390319:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65ff4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390327:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a82b92800) 00010000:00010000:0.0:1788510475.390330:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788510475.390333:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65ff4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510475.390339:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed65ff4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510475.390642:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11507:x1875388852683520:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 41930us (42092us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788510475.390653:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 186 00000020:00080000:0.0:1788510475.390658:0:9544:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788510475.390668:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510475.390673:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510475.391138:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788510475.391149:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788510475.393698:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510475.393778:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852684416 00000100:00100000:3.0:1788510475.393788:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852684416 00000100:00100000:3.0:1788510475.393870:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 50 00000100:00100000:3.0:1788510475.393881:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11507:x1875388852684416:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788510475.394614:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788510475.394706:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788510475.394750:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66009 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.394768:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.394780:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.394798:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66009 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.394804:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66009 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.394810:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66009 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510475.394830:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788510475.394916:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:11507:x1875388852684416:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 1036us (1226us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788510475.394925:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 50 00000020:00080000:3.0:1788510475.394929:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788510475.395094:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510475.395102:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66009 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.395110:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510475.395114:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66009 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.395121:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66009 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.395133:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff929a83eab900) 00010000:00010000:2.0:1788510475.395141:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788510475.395145:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66009 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.395150:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66009 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510475.395165:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510475.395167:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510475.395168:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510475.526734:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510475.972449:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875388861069184:0@lo:400:kworker.0 00000100:00100000:2.0:1788510475.972478:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861069440:0@lo:400:kworker.0 00000100:00100000:0.0:1788510475.972554:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861069312:0@lo:400:kworker.0 00000100:00100000:1.0:1788510475.972668:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861069056:0@lo:400:kworker.0 00000100:00100000:2.0:1788510475.976218:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510475.976277:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510475.976385:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861069184 00000100:00100000:0.0:1788510475.976483:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510475.976634:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861069312 00000100:00100000:3.0:1788510475.976642:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861069312 00000100:00100000:3.0:1788510475.976704:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788510475.976716:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861069312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510475.976808:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861069312:12345-0@lo:400:kworker.0 Request processed in 95us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510475.976815:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788510475.976874:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861069312:0@lo:400:kworker.0 00000100:00100000:3.0:1788510475.976909:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861069440 00000100:00100000:3.0:1788510475.976913:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861069440 00000100:00100000:3.0:1788510475.976942:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788510475.976964:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861069440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510475.977004:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861069440:12345-0@lo:400:kworker.0 Request processed in 41us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510475.977455:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788510475.977508:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861069440:0@lo:400:kworker.0 00000100:00080000:0.0:1788510475.977647:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510475.977892:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510475.977895:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861069184 00000100:00100000:2.0:1788510475.977938:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788510475.977947:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875388861069184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510475.977999:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875388861069184:12345-0@lo:400:kworker.0 Request processed in 54us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510475.978006:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788510475.978074:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875388861069184:0@lo:400:kworker.0 00000100:00100000:1.0:1788510475.978500:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861069568:0@lo:400:kworker.0 00000100:00100000:1.0:1788510475.978622:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510475.978743:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861069568 00000100:00100000:2.0:1788510475.980283:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861069568 00000100:00100000:2.0:1788510475.980394:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788510475.980406:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861069568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510475.980510:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861069568:12345-0@lo:400:kworker.0 Request processed in 107us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510475.980518:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788510475.980722:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861069568:0@lo:400:kworker.0 00000100:00080000:0.0:1788510475.980805:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510475.984758:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861069056 00000100:00100000:3.0:1788510475.984779:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861069056 00000100:00100000:3.0:1788510475.984874:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788510475.984886:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861069056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510475.987736:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861069056:12345-0@lo:400:kworker.0 Request processed in 2836us (9827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510475.987766:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788510475.991667:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861069056:0@lo:400:kworker.0 00000100:00100000:3.0:1788510476.486881:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861069696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788510476.486957:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510476.487042:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861069696 00000100:00100000:3.0:1788510476.487065:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861069696 00000100:00100000:3.0:1788510476.487117:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788510476.487127:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875388861069696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788510476.487166:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510476.487215:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875388861069696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510476.487242:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788510476.487298:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861069696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788510476.550274:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788510476.570968:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1788510476.570988:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:1.0:1788510477.091272:0:12543:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788510477.091290:0:12543:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788510477.091336:0:12543:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788510477.091343:0:12543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788510477.288467:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510477.288564:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852684672 00000100:00100000:2.0:1788510477.288577:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852684672 00000100:00100000:2.0:1788510477.288653:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 187 00000100:00100000:2.0:1788510477.288665:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a89045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:11525:x1875388852684672:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510477.288692:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510477.288732:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734d3 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.288871:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66017 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.288886:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66017 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.288900:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66017 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510477.288912:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788510477.289067:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734d3 expref: 25 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.289088:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66017 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734d3 expref: 24 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.289099:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:2.0:1788510477.289102:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788510477.289106:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76c00, rc 0) 00000100:00100000:2.0:1788510477.289187:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a89045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:11525:x1875388852684672:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 524us (733us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788510477.289209:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 187 00000100:00080000:0.0:1788510477.289408:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510477.295801:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.295885:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852684800 00000100:00100000:3.0:1788510477.295897:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852684800 00000100:00100000:3.0:1788510477.295967:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 188 00000100:00100000:3.0:1788510477.295976:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:11525:x1875388852684800:12345-192.168.201.4@tcp:34:lfs.0 00010000:00010000:3.0:1788510477.296052:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66025 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296082:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296094:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296137:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6602c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296145:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6602c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296151:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6602c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296421:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296429:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296436:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788510477.296483:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296496:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296508:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66025 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296515:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296521:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510477.296526:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296533:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66025 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296545:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:3.0:1788510477.296548:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510477.296553:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66025 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296560:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66025 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296572:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6602c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296578:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6602c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296584:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6602c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296588:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510477.296599:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6602c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296606:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6602c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296614:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a83eabe00) 00010000:00010000:3.0:1788510477.296616:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510477.296619:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6602c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296625:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6602c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296639:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296644:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66033 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296650:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296654:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510477.296657:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296662:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66033 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296669:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a83eab400) 00010000:00010000:3.0:1788510477.296671:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510477.296680:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66033 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.296685:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510477.296778:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:11525:x1875388852684800:12345-192.168.201.4@tcp:34:lfs.0 Request processed in 802us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510477.296787:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 188 00000100:00100000:0.0:1788510477.344849:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510477.344962:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852685056 00000100:00100000:1.0:1788510477.344973:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852685056 00000100:00100000:1.0:1788510477.345054:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 189 00000100:00100000:1.0:1788510477.345067:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:11528:x1875388852685056:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510477.345091:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510477.345116:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6603a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734da expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.345215:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66041 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.345252:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.345267:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345315:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed66048 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345326:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed66048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345335:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed66048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345616:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6604f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345626:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6604f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345644:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6604f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510477.345657:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788510477.345759:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345768:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66041 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345776:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66041 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345783:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510477.345788:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66041 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345797:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66041 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345811:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510477.345814:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510477.345819:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66041 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345826:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66041 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345838:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed66048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345845:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed66048 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345858:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed66048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345864:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510477.345867:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed66048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345874:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed66048 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345883:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a8b8f5800) 00010000:00010000:0.0:1788510477.345886:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510477.345889:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed66048 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345895:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed66048 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345945:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6603a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734da expref: 27 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345961:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6604f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734da expref: 26 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.345970:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:0.0:1788510477.345972:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510477.345975:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafe00, rc 0) 00000100:00100000:0.0:1788510477.346441:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:11528:x1875388852685056:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 1374us (1600us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788510477.346464:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 189 00000100:00100000:2.0:1788510477.361090:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.361182:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852685184 00000100:00100000:3.0:1788510477.361193:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852685184 00000100:00100000:3.0:1788510477.361279:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 190 00000100:00100000:3.0:1788510477.361290:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:11528:x1875388852685184:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:3.0:1788510477.361366:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6605d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.361385:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6605d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.361408:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6605d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.361440:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6605d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.361447:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6605d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.361454:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6605d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.361460:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510477.361480:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6605d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.361488:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6605d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.361502:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:3.0:1788510477.361506:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788510477.361511:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6605d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.361518:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6605d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510477.361616:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:11528:x1875388852685184:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 327us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510477.361623:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 190 00000100:00100000:2.0:1788510477.368949:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510477.369031:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852685440 00000100:00100000:1.0:1788510477.369049:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852685440 00000100:00100000:1.0:1788510477.369113:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 51 00000100:00100000:1.0:1788510477.369123:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:11528:x1875388852685440:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:1.0:1788510477.369425:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:11528:x1875388852685440:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 301us (486us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788510477.369433:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 51 00000100:00100000:2.0:1788510477.418708:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.418812:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852685696 00000100:00100000:3.0:1788510477.418825:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852685696 00000100:00100000:3.0:1788510477.418896:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 191 00000100:00100000:3.0:1788510477.418908:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:11054:x1875388852685696:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:3.0:1788510477.418941:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510477.418967:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66064 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734e1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.419378:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.419405:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6604f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734da expref: 28 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.419441:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.419482:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6604f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734da expref: 28 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.419496:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6604f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734da expref: 28 pid: 9544 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510477.419512:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae949c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861069824:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510477.419633:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa51a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788510477.435666:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.435886:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae949c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861069824:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510477.435922:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510477.444693:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852685824 00000100:00100000:0.0:1788510477.444715:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852685824 00010000:00010000:0.0:1788510477.444773:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6604f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734da expref: 29 pid: 9544 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510477.444904:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 74 00000100:00100000:0.0:1788510477.444916:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+29:2340:x1875388852685824:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510477.444935:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510477.444944:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6604f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734da expref: 29 pid: 9544 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.444960:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6604f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734da expref: 29 pid: 9544 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.444985:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed6604f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734da expref: 29 pid: 9544 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.445002:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:0.0:1788510477.445018:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.445039:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.445049:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.445103:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788510477.445266:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.445275:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510477.445300:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788510477.445483:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66064 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e1 expref: 30 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.445500:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e1 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.445519:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:3.0:1788510477.445523:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788510477.445526:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68200, rc 0) 00000100:00100000:0.0:1788510477.445909:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+29:2340:x1875388852685824:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 993us (10260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510477.445918:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 74 00000100:00100000:3.0:1788510477.448514:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:11054:x1875388852685696:12345-192.168.201.4@tcp:101:bash.0 Request processed in 29592us (29802us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788510477.448531:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 191 00000100:00100000:2.0:1788510477.457675:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.457769:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852686080 00000100:00100000:3.0:1788510477.457781:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852686080 00000100:00100000:3.0:1788510477.457854:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 192 00000100:00100000:3.0:1788510477.457867:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:11054:x1875388852686080:12345-192.168.201.4@tcp:36:bash.0 00010000:00010000:3.0:1788510477.458200:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66079 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.458254:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.458270:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788510477.458326:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788510477.458349:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6783184 reply state 00000000b941539c transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510477.458358:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788510477.458412:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788510477.458537:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:11054:x1875388852686080:12345-192.168.201.4@tcp:36:bash.0 Request processed in 671us (873us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788510477.458545:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 192 00000020:00080000:3.0:1788510477.458563:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788510477.462483:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.462510:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66079 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.462519:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66079 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.462526:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510477.462531:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66079 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.462541:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66079 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.462560:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:3.0:1788510477.462563:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510477.462569:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66079 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.462576:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66079 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510477.472901:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510477.478181:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852686208 00000100:00100000:0.0:1788510477.478202:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852686208 00000100:00100000:0.0:1788510477.478337:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 193 00000100:00100000:0.0:1788510477.478349:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:11054:x1875388852686208:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:0.0:1788510477.478375:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510477.478432:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed66080 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734e8 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.478509:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed66080 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e8 expref: 32 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.478526:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed66080 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e8 expref: 32 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.478551:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:0.0:1788510477.478554:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788510477.478559:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafe00, rc 0) 00000100:00100000:0.0:1788510477.478648:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:11054:x1875388852686208:12345-192.168.201.4@tcp:101:bash.0 Request processed in 301us (5758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510477.478656:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 193 00000100:00100000:1.0:1788510477.486621:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510477.486736:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852686336 00000100:00100000:0.0:1788510477.486747:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852686336 00000100:00100000:0.0:1788510477.486841:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 58 00000100:00100000:0.0:1788510477.486852:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:11054:x1875388852686336:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:0.0:1788510477.486872:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510477.486891:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb06f87b/0x3e734462ed66087 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734ef expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788510477.486917:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9a8109, atime: 0x6a9a8108, ctime: 0x6a9a8109, blocks: 0xb 00010000:00010000:0.0:1788510477.486942:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1788510477.486948:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510477.486957:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb06f87b/0x3e734462ed66087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734ef expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.486976:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb06f87b/0x3e734462ed66087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734ef expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.486989:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae400, rc 0) 00000100:00100000:0.0:1788510477.487054:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:11054:x1875388852686336:12345-192.168.201.4@tcp:101:bash.0 Request processed in 204us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510477.487070:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 58 00000100:00080000:2.0:1788510477.487502:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788510477.491455:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.491557:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852686464 00000100:00100000:3.0:1788510477.491566:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852686464 00002000:00010000:3.0:1788510477.491603:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788510477.491608:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aaeca2d80 with x1875388852686464 ext(0->18446744073709551615) 00002000:00010000:3.0:1788510477.491619:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929aaeca2d80. 00000100:00100000:3.0:1788510477.491679:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 5 00000100:00100000:3.0:1788510477.491688:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852686464:12345-192.168.201.4@tcp:10:bash.0 00002000:00010000:3.0:1788510477.491947:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788510477.491951:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788510473 -> 1788510477 00002000:00010000:3.0:1788510477.491953:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788510472 -> 1788510472 00002000:00010000:3.0:1788510477.491955:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788510473 -> 1788510477 00002000:00010000:3.0:1788510477.491957:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788510477.492026:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2340:x1875388852686464:12345-192.168.201.4@tcp:10:bash.0 Request processed in 332us (573us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788510477.492034:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 5 00002000:00010000:3.0:1788510477.492038:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788510477.492040:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aaeca2d80 with x1875388852686464 ext(0->18446744073709551615) 00002000:00010000:3.0:1788510477.492044:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929aaeca2d80. 00000100:00100000:3.0:1788510477.562263:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510477.562339:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852686592 00000100:00100000:1.0:1788510477.562349:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852686592 00000100:00100000:1.0:1788510477.562496:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 194 00000100:00100000:1.0:1788510477.562510:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:11543:x1875388852686592:12345-192.168.201.4@tcp:34:lfs.0 00010000:00010000:1.0:1788510477.562602:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6608e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.562623:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6608e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.562635:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6608e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.562671:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66095 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.562678:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.562684:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.562948:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6609c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.562958:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6609c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.562964:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6609c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788510477.563008:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6609c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563020:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6608e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563026:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6608e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563033:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6608e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563039:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510477.563043:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6608e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563068:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6608e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563082:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:1.0:1788510477.563085:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510477.563091:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6608e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563098:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6608e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563114:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563121:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66095 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563127:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563132:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510477.563135:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563151:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66095 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563160:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a82b92100) 00010000:00010000:1.0:1788510477.563163:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510477.563166:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66095 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563182:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563200:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6609c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563205:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6609c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563210:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6609c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563215:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510477.563218:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6609c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563270:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6609c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563279:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:1.0:1788510477.563282:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510477.563285:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6609c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.563290:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6609c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510477.563369:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:11543:x1875388852686592:12345-192.168.201.4@tcp:34:lfs.0 Request processed in 860us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510477.563377:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 194 00010000:00010000:3.0:1788510477.583498:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510477.594503:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510477.594612:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852686848 00000100:00100000:0.0:1788510477.594625:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852686848 00000100:00100000:0.0:1788510477.594701:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 195 00000100:00100000:0.0:1788510477.594714:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+32:11546:x1875388852686848:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510477.594742:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510477.594767:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed660a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734f6 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.594871:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed660aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.594889:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed660aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.594902:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed660aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.594917:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed660b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.594924:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed660b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.594931:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed660b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.595350:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed660b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.595361:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed660b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.595369:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed660b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510477.595378:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788510477.595517:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed660aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595525:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed660aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595531:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed660aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595537:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510477.595541:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed660aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595549:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed660aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595562:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:1.0:1788510477.595565:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510477.595569:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed660aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595575:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae000/0x3e734462ed660aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595588:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed660b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595593:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed660b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595598:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed660b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595609:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510477.595611:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed660b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595615:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed660b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595621:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a8b8f5000) 00010000:00010000:1.0:1788510477.595623:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510477.595624:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed660b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595628:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf800/0x3e734462ed660b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595672:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf600/0x3e734462ed660a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734f6 expref: 35 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595682:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed660b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734f6 expref: 34 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510477.595687:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:1.0:1788510477.595688:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788510477.595690:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae200, rc 0) 00000100:00100000:1.0:1788510477.595743:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+34:11546:x1875388852686848:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 1032us (1252us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788510477.595749:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 195 00000100:00100000:2.0:1788510477.598640:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.598781:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852686976 00000100:00100000:3.0:1788510477.598794:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852686976 00000100:00100000:3.0:1788510477.598872:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 196 00000100:00100000:3.0:1788510477.598882:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+34:11546:x1875388852686976:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:3.0:1788510477.598949:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.598969:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e1 expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.598980:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.599020:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e1 expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.599251:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e1 expref: 34 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510477.599269:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae948e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861069952:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510477.599366:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa51900 going to sleep for 11 seconds 00000100:00100000:2.0:1788510477.602790:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.602896:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae948e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861069952:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510477.602919:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510477.603011:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852687232 00000100:00100000:1.0:1788510477.603030:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852687232 00000100:00100000:1.0:1788510477.603094:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 52 00000100:00100000:1.0:1788510477.603104:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+35:5581:x1875388852687232:12345-192.168.201.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788510477.603763:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:5581:x1875388852687232:12345-192.168.201.4@tcp:35:ldlm_bl.0 Request processed in 657us (979us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788510477.603773:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 52 00000100:00100000:1.0:1788510477.606866:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.606960:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852687360 00000100:00100000:3.0:1788510477.606969:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852687360 00010000:00010000:3.0:1788510477.607122:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e1 expref: 36 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510477.607169:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 75 00000100:00100000:3.0:1788510477.607180:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:2340:x1875388852687360:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510477.607197:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510477.607204:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e1 expref: 36 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.607216:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e1 expref: 36 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.607262:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed6606b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e1 expref: 36 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.607311:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:3.0:1788510477.607316:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.607326:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.607333:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.607446:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510477.607514:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+35:2340:x1875388852687360:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 335us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510477.607523:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 75 00010000:00010000:2.0:1788510477.609336:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.609354:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.609437:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.609445:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.609454:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.609460:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510477.609465:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.609492:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.609512:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:2.0:1788510477.609515:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788510477.609521:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.609528:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed660c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510477.609634:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+34:11546:x1875388852686976:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 10748us (11001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510477.609645:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 196 00000100:00100000:1.0:1788510477.611985:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.612380:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852687616 00000100:00100000:3.0:1788510477.612411:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852687616 00000100:00100000:3.0:1788510477.612475:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 53 00000100:00100000:3.0:1788510477.612486:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+34:11546:x1875388852687616:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510477.612761:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+35:11546:x1875388852687616:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 275us (788us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788510477.612769:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 53 00000100:00100000:0.0:1788510477.693953:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.694059:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852687872 00000100:00100000:3.0:1788510477.694069:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852687872 00000100:00100000:3.0:1788510477.694408:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 197 00000100:00100000:3.0:1788510477.694420:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+35:11557:x1875388852687872:12345-192.168.201.4@tcp:101:cat.0 00010000:00010000:3.0:1788510477.694450:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510477.694490:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed660cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc734fd expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.694578:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed660d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.694595:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed660d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.694608:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed660d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.694623:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed660db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.694631:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed660db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.694638:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed660db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.694989:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed660e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.694999:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed660e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695064:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed660e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510477.695077:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788510477.695594:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed660d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695617:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed660d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695625:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed660d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695632:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510477.695637:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed660d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695645:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed660d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695881:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:3.0:1788510477.695885:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510477.695890:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed660d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695898:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed660d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695911:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed660db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695918:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed660db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695924:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed660db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695929:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510477.695938:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed660db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695945:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed660db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695953:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a83eab400) 00010000:00010000:3.0:1788510477.695956:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510477.695958:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed660db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.695964:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed660db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.696081:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed660cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734fd expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.696100:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed660e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734fd expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.696109:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:3.0:1788510477.696111:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510477.696114:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69200, rc 0) 00000100:00100000:3.0:1788510477.696495:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+37:11557:x1875388852687872:12345-192.168.201.4@tcp:101:cat.0 Request processed in 2076us (2549us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788510477.696505:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 197 00000100:00100000:2.0:1788510477.701900:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.702051:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852688128 00000100:00100000:3.0:1788510477.702061:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852688128 00000100:00100000:3.0:1788510477.702133:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 54 00000100:00100000:3.0:1788510477.702154:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+37:11557:x1875388852688128:12345-192.168.201.4@tcp:35:cat.0 00000100:00100000:3.0:1788510477.702491:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+38:11557:x1875388852688128:12345-192.168.201.4@tcp:35:cat.0 Request processed in 347us (600us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788510477.702500:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 54 00000100:00100000:1.0:1788510477.729754:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510477.729917:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852688384 00000100:00100000:0.0:1788510477.729927:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852688384 00000100:00100000:0.0:1788510477.730013:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 198 00000100:00100000:0.0:1788510477.730024:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+38:11558:x1875388852688384:12345-192.168.201.4@tcp:36:rm.0 00010000:00010000:0.0:1788510477.730094:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788510477.730123:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed660e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734fd expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.730302:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed660b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734f6 expref: 37 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.730319:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed66080 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734e8 expref: 36 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.730330:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5600) 00010000:00010000:0.0:1788510477.730340:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510477.730361:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed660f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.730374:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed660f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.730383:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed660f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.730408:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed660f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.730416:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed660f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.730423:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed660f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.730981:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed660fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.730992:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed660fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.731000:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed660fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788510477.735893:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1788510477.735909:0:5821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 335554685449ns, next at 336554682220ns, rc = 0 00010000:00010000:0.0:1788510477.735998:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed66105 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736036:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed66105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736050:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed66105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736059:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed66105 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736064:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed66105 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736070:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed66105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736100:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788510477.736122:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed660fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736156:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed660fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736163:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed660fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736168:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510477.736173:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed660fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736181:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed660fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736194:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5300) 00010000:00010000:0.0:1788510477.736197:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788510477.736203:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed660fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736211:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf200/0x3e734462ed660fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736261:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed660f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736267:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed660f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736272:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed660f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736276:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510477.736286:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed660f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736292:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed660f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736300:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510477.736302:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510477.736305:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed660f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.736311:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed660f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510477.736323:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006642a756 reply state 000000003547ba54 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed660f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510477.736332:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788510477.736462:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+37:11558:x1875388852688384:12345-192.168.201.4@tcp:36:rm.0 Request processed in 6434us (6715us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788510477.736472:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 198 00010000:00010000:2.0:1788510477.737176:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510477.737185:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed66105 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.737192:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafa00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510477.737196:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed66105 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.737204:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed66105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.737216:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff929a8b8f5300) 00010000:00010000:2.0:1788510477.737219:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788510477.737256:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed66105 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.737279:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed66105 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.737302:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510477.737304:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510477.737306:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510477.740443:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed660f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.740475:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed660f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.740484:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed660f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.740491:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510477.740497:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed660f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.740505:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed660f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.740535:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a8b8f5a00) 00010000:00010000:3.0:1788510477.740538:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510477.740545:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed660f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.740552:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed660f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510477.786912:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510477.787048:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852688640 00000100:00100000:2.0:1788510477.787061:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852688640 00000100:00100000:2.0:1788510477.787126:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 199 00000100:00100000:2.0:1788510477.787138:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+36:11564:x1875388852688640:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510477.787184:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510477.787214:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed6610c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73504 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.787378:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66113 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.787407:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66113 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.787422:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66113 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.787442:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed6611a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.787450:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed6611a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.787457:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed6611a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788510477.789489:0:9544:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788510477.791989:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.792312:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.792329:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.792375:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66113 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.792384:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66113 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.792405:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66113 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.792412:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510477.792417:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66113 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.792425:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66113 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.792438:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:2.0:1788510477.792441:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510477.792447:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66113 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.792474:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66113 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788510477.792493:0:9544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003af22016 reply state 0000000090f4a9cb transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed6611a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510477.792503:0:9544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788510477.792626:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed6610c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73504 expref: 39 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.792643:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73504 expref: 38 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.792725:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578b00) 00010000:00010000:2.0:1788510477.792728:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510477.792730:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77400, rc 0) 00000100:00100000:2.0:1788510477.792839:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+39:11564:x1875388852688640:12345-192.168.201.4@tcp:101:bash.0 Request processed in 5702us (5938us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788510477.792849:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 199 00010000:00010000:3.0:1788510477.798239:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed6611a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.798259:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed6611a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.798277:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed6611a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.798282:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510477.798286:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed6611a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.798292:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed6611a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.798307:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929aac578d00) 00010000:00010000:3.0:1788510477.798309:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510477.798312:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed6611a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.798317:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed6611a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510477.798757:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510477.798824:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852688768 00000100:00100000:0.0:1788510477.798838:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852688768 00000100:00100000:0.0:1788510477.798909:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 59 00000100:00100000:0.0:1788510477.798919:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaefeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2341:x1875388852688768:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:0.0:1788510477.798937:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510477.798956:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed6612f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7350b expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788510477.798984:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788510477.799010:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1788510477.799015:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510477.799026:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed6612f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7350b expref: 6 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.799049:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed6612f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7350b expref: 6 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.799063:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf000, rc 0) 00000100:00100000:0.0:1788510477.799121:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaefeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2341:x1875388852688768:12345-192.168.201.4@tcp:101:bash.0 Request processed in 204us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510477.799129:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 59 00000100:00080000:2.0:1788510477.799385:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510477.801886:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.801932:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852688896 00000100:00100000:3.0:1788510477.801945:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852688896 00000100:00100000:3.0:1788510477.802021:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 60 00000100:00100000:3.0:1788510477.802033:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:11564:x1875388852688896:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:3.0:1788510477.802059:0:12047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510477.802082:0:12047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73512 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.802116:0:12047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed6612f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7350b expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.802147:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788510477.802161:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788510477.802166:0:12047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 7 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.802205:0:12047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed6612f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7350b expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.802216:0:12047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed6612f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7350b expref: 7 pid: 6670 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510477.802256:0:12047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae94b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12047:1875388861070080:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510477.802369:0:12047:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa51180 going to sleep for 11 seconds 00000100:00100000:1.0:1788510477.805588:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510477.805829:0:12047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae94b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12047:1875388861070080:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510477.805875:0:12047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 7 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510477.805899:0:12047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68200, rc 0) 00000100:00100000:3.0:1788510477.805984:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:11564:x1875388852688896:12345-192.168.201.4@tcp:101:bash.0 Request processed in 3952us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510477.805993:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 60 00000100:00100000:0.0:1788510477.806789:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852689024 00000100:00100000:0.0:1788510477.806801:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852689024 00010000:00010000:0.0:1788510477.806849:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed6612f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7350b expref: 7 pid: 6670 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510477.806899:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 76 00000100:00100000:0.0:1788510477.806910:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852689024:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510477.806926:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510477.806954:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed6612f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7350b expref: 7 pid: 6670 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.806968:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed6612f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7350b expref: 7 pid: 6670 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.807040:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed6612f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7350b expref: 7 pid: 6670 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.807059:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510477.807064:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510477.807073:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 6 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.807083:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 6 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510477.807120:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 6 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510477.807135:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d31f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1875388861070208:192.168.201.4@tcp:105: 00000100:00100000:0.0:1788510477.807284:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a83095600 going to sleep for 11 seconds 00000100:00100000:0.0:1788510477.811535:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d31f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1875388861070208:192.168.201.4@tcp:105: 00010000:00010000:0.0:1788510477.811566:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510477.811569:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510477.811635:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852689024:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 4725us (6060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510477.811647:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 76 00000100:00100000:3.0:1788510477.811896:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852689280 00000100:00100000:3.0:1788510477.811904:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852689280 00000100:00100000:3.0:1788510477.811955:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 55 00000100:00100000:3.0:1788510477.811978:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+38:11564:x1875388852689280:12345-192.168.201.4@tcp:35:bash.0 00000100:00100000:3.0:1788510477.813216:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+39:11564:x1875388852689280:12345-192.168.201.4@tcp:35:bash.0 Request processed in 1230us (1638us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788510477.813262:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 55 00000100:00100000:1.0:1788510477.989575:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510477.989689:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852689408 00000100:00100000:2.0:1788510477.989701:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852689408 00000100:00100000:2.0:1788510477.989779:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 200 00000100:00100000:2.0:1788510477.989791:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+39:11580:x1875388852689408:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510477.989820:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510477.989846:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed6613d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73519 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.989937:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.989952:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.989964:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510477.989998:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788510477.990014:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510477.990038:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.990063:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed6613d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73519 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.990081:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73519 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510477.990090:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:2.0:1788510477.990092:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510477.990096:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77200, rc 0) 00000100:00100000:2.0:1788510477.990166:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+40:11580:x1875388852689408:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 376us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510477.990173:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 200 00000100:00100000:2.0:1788510478.000751:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.000859:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852689664 00000100:00100000:3.0:1788510478.000872:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852689664 00000100:00100000:3.0:1788510478.000967:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 201 00000100:00100000:3.0:1788510478.000978:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+40:11580:x1875388852689664:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:3.0:1788510478.001008:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510478.001031:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed6614b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73520 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.001271:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.001290:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.001305:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510478.001318:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788510478.001462:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed6614b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73520 expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.001484:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73520 expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.001518:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578b00) 00010000:00010000:3.0:1788510478.001522:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510478.001527:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69e00, rc 0) 00000100:00100000:3.0:1788510478.001658:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+42:11580:x1875388852689664:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 681us (922us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788510478.001667:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 201 00000100:00100000:3.0:1788510478.005284:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510478.005572:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852689920 00000100:00100000:2.0:1788510478.005602:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852689920 00000100:00100000:2.0:1788510478.005664:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 202 00000100:00100000:2.0:1788510478.005677:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+42:11580:x1875388852689920:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510478.005710:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510478.005735:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66160 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73527 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.005863:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66167 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.005880:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.005893:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510478.005907:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788510478.006108:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66160 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73527 expref: 45 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.006128:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73527 expref: 44 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.006136:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578b00) 00010000:00010000:2.0:1788510478.006139:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788510478.006212:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76000, rc 0) 00000100:00100000:2.0:1788510478.006422:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+44:11580:x1875388852689920:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 746us (1153us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788510478.006430:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 202 00000100:00100000:1.0:1788510478.010665:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.010773:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852690048 00000100:00100000:3.0:1788510478.010788:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852690048 00000100:00100000:3.0:1788510478.010874:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:3.0:1788510478.010886:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+44:2341:x1875388852690048:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510478.010902:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510478.010928:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73520 expref: 44 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.010949:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578b00) 00010000:00010000:3.0:1788510478.010956:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510478.011023:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+43:2341:x1875388852690048:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 138us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510478.011031:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:1.0:1788510478.017078:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.017212:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852690176 00000100:00100000:0.0:1788510478.017361:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852690176 00000100:00100000:0.0:1788510478.017469:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 61 00000100:00100000:0.0:1788510478.017481:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+6:2340:x1875388852690176:12345-192.168.201.4@tcp:1:lfs.0 00010000:00010000:0.0:1788510478.017664:0:8183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.017691:0:8183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 6 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.017702:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510478.017707:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788510478.017713:0:8183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.017760:0:8183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 6 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.017779:0:8183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 6 pid: 12047 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.017796:0:8183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8183:1875388861070336:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510478.018139:0:8183:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a83095600 going to sleep for 11 seconds 00000100:00100000:1.0:1788510478.023417:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.023564:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852690304 00000100:00100000:3.0:1788510478.023577:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852690304 00002000:00100000:3.0:1788510478.023630:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff929ab7dd7b80 x1875388852690304/t0(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:49/0 lens 504/0 e 0 to 0 dl 1788510489 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788510478.023642:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929ab7dd7b80 with x1875388852690304 ext(0->8) 00010000:00010000:3.0:1788510478.023669:0:6674:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 7 pid: 12047 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.023689:0:6674:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 7 pid: 12047 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788510478.023699:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff929ab7dd7b80 00000100:00100000:3.0:1788510478.023746:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 3 00000100:00100000:3.0:1788510478.023760:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852690304:12345-192.168.201.4@tcp:4:lfs.0 00000100:00100000:3.0:1788510478.024640:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2340:x1875388852690304:12345-192.168.201.4@tcp:4:lfs.0 Request processed in 878us (1249us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788510478.024652:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 3 00002000:00100000:3.0:1788510478.024661:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff929ab7dd7b80 x1875388852690304/t4294967308(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:49/0 lens 504/448 e 0 to 0 dl 1788510489 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788510478.024671:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929ab7dd7b80 with x1875388852690304 ext(0->8) 00010000:00010000:3.0:1788510478.024679:0:6674:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 9 pid: 12047 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.024694:0:6674:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 9 pid: 12047 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788510478.024702:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff929ab7dd7b80 00000100:00100000:2.0:1788510478.024820:0:8183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8183:1875388861070336:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510478.024853:0:8183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.028697:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.028788:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852690432 00000100:00100000:0.0:1788510478.028798:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852690432 00010000:00010000:0.0:1788510478.028842:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 9 pid: 12047 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.028932:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 77 00000100:00100000:0.0:1788510478.028943:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2343:x1875388852690432:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510478.028975:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788510478.028994:0:5806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788510478.028997:0:5806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788510477 00002000:00010000:0.0:1788510478.029000:0:5806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788510477 00002000:00010000:0.0:1788510478.029013:0:5806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788510477 00010000:00010000:0.0:1788510478.029021:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 9 pid: 12047 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.029044:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 9 pid: 12047 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.029071:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e4f0790/0x3e734462ed66136 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73512 expref: 9 pid: 12047 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.029089:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788510478.029094:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788510478.029101:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.029111:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.029145:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510478.029213:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2343:x1875388852690432:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 271us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.029253:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 77 00010000:00010000:2.0:1788510478.029968:0:8183:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.029981:0:8183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.030019:0:8183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.030035:0:8183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.030044:0:8183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.030051:0:8183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510478.030056:0:8183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.030066:0:8183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.030095:0:8183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.030103:0:8183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031427651/0x3e734462ed66175 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.030175:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852690176:12345-192.168.201.4@tcp:1:lfs.0 Request processed in 12694us (13111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510478.030184:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 61 00000100:00100000:2.0:1788510478.033655:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.033747:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852690688 00000100:00100000:1.0:1788510478.033762:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852690688 00000100:00100000:1.0:1788510478.033945:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 56 00000100:00100000:1.0:1788510478.033958:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+43:11580:x1875388852690688:12345-192.168.201.4@tcp:35:lfs.0 00000004:00010000:1.0:1788510478.034044:0:5824:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73527 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788510478.034510:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788510478.034557:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788510478.034918:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788510478.034989:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.035349:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66121 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73504 expref: 47 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.035361:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.035414:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73504 expref: 47 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.035430:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73504 expref: 47 pid: 9544 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.035446:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5824:1875388861070464:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510478.035532:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b33900 going to sleep for 11 seconds 00000100:00100000:1.0:1788510478.038112:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.038318:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5824:1875388861070464:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510478.038353:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.038612:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852690816 00000100:00100000:2.0:1788510478.038620:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852690816 00010000:00010000:2.0:1788510478.038661:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73504 expref: 48 pid: 9544 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.038735:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 78 00000100:00100000:2.0:1788510478.038746:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+48:2340:x1875388852690816:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510478.038762:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510478.038769:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73504 expref: 48 pid: 9544 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.038782:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73504 expref: 48 pid: 9544 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.038802:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73504 expref: 48 pid: 9544 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.038829:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578b00) 00010000:00010000:2.0:1788510478.038834:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.038845:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.038866:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.038897:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510478.038960:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+47:2340:x1875388852690816:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 216us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510478.038968:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 78 00010000:00010000:1.0:1788510478.039035:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.039044:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788510478.039197:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788510478.039438:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788510478.039581:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1875388861070592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788510478.039639:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510478.039684:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510478.039809:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861070592 00000100:00100000:0.0:1788510478.039816:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861070592 00000100:00080000:3.0:1788510478.039860:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510478.039876:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788510478.039887:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1875388861070592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788510478.039969:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1875388861070592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.039977:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788510478.040338:0:5824:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788510478.040345:0:5824:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1788510478.040364:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff929aaed52d80, transno 4294967307 00000100:00100000:3.0:1788510478.040377:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1875388861070592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788510478.040839:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788510478.040904:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae948e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1875388861070720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788510478.040944:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510478.041015:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa51480 going to sleep for 11 seconds 00000100:00100000:1.0:1788510478.041403:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861070720 00000100:00100000:1.0:1788510478.041418:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861070720 00000100:00100000:1.0:1788510478.041496:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788510478.041506:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1875388861070720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788510478.041682:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1875388861070720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 177us (736us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788510478.041690:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788510478.041764:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae948e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1875388861070720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788510478.041817:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788510478.041853:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.041864:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.041872:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.041878:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510478.041882:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.041891:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.041907:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578b00) 00010000:00010000:3.0:1788510478.041916:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788510478.041921:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.041929:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed6617c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788510478.042083:0:5824:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788510478.042196:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1788510478.042206:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335860982712ns, next at 336860980857ns, rc = 0 00000001:00080000:3.0:1788510478.042212:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788510478.042276:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578b00) 00010000:00010000:3.0:1788510478.042280:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788510478.042287:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66167 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73527 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510478.042403:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+50:11580:x1875388852690688:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 8447us (8758us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788510478.042412:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 56 00000020:00080000:3.0:1788510478.042417:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788510478.047507:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510478.047932:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852690944 00000100:00100000:2.0:1788510478.047943:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852690944 00000100:00100000:2.0:1788510478.048010:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 203 00000100:00100000:2.0:1788510478.048020:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+50:11580:x1875388852690944:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510478.048044:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510478.048065:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66183 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7352e expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.048124:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7352e expref: 51 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.048141:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7352e expref: 51 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.048180:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:2.0:1788510478.048184:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788510478.048187:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77400, rc 0) 00000100:00100000:2.0:1788510478.048259:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+51:11580:x1875388852690944:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 240us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510478.048267:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 203 00000100:00100000:0.0:1788510478.054942:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.055053:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852691200 00000100:00100000:3.0:1788510478.055064:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852691200 00000100:00100000:3.0:1788510478.055138:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 57 00000100:00100000:3.0:1788510478.055158:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+51:11580:x1875388852691200:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510478.055421:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+52:11580:x1875388852691200:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 265us (501us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788510478.055428:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 57 00000100:00100000:0.0:1788510478.115975:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.116431:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852691328 00000100:00100000:1.0:1788510478.116446:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852691328 00000100:00100000:1.0:1788510478.116585:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 204 00000100:00100000:1.0:1788510478.116597:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+52:11590:x1875388852691328:12345-192.168.201.4@tcp:34:lfs.0 00010000:00010000:1.0:1788510478.116736:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6618a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116753:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6618a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116764:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6618a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116779:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66191 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116785:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116792:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116883:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116904:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116911:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788510478.116953:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116966:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6618a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116972:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6618a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116978:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6618a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116983:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510478.116988:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6618a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.116996:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6618a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117182:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:1.0:1788510478.117186:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510478.117191:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6618a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117197:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed6618a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117251:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117258:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66191 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117263:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117268:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510478.117271:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117277:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66191 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117284:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a82b92100) 00010000:00010000:1.0:1788510478.117357:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510478.117362:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66191 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117368:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66191 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117410:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117416:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66198 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117421:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117431:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510478.117434:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117440:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66198 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117449:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510478.117451:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510478.117454:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66198 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.117459:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66198 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.121863:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+52:11590:x1875388852691328:12345-192.168.201.4@tcp:34:lfs.0 Request processed in 5255us (5886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510478.121882:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 204 00000100:00100000:1.0:1788510478.153321:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.153470:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852691584 00000100:00100000:3.0:1788510478.153494:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852691584 00000100:00100000:3.0:1788510478.153592:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 205 00000100:00100000:3.0:1788510478.153615:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+52:11593:x1875388852691584:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:3.0:1788510478.153652:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510478.153683:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6619f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73535 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.153774:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed661a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.153790:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed661a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.153804:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed661a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.153821:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed661ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.153829:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed661ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.153836:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed661ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154310:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed661b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154320:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed661b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154326:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed661b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510478.154348:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788510478.154465:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed661a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154473:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed661a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154838:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed661a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154847:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510478.154851:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed661a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154918:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed661a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154930:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:3.0:1788510478.154934:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510478.154938:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed661a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154944:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed661a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154970:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed661ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154976:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed661ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154981:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed661ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.154994:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510478.155205:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed661ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.155213:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed661ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.155257:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a83eab400) 00010000:00010000:3.0:1788510478.155260:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510478.155263:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed661ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.155270:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed661ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.155919:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed6619f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73535 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.155941:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed661b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73535 expref: 54 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.155949:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:3.0:1788510478.155951:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510478.155954:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69200, rc 0) 00000100:00100000:3.0:1788510478.156525:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:11593:x1875388852691584:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 2920us (3214us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788510478.156536:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 205 00000100:00100000:2.0:1788510478.165991:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.166080:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852691712 00000100:00100000:3.0:1788510478.166328:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852691712 00000100:00100000:2.0:1788510478.166592:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 206 00000100:00100000:2.0:1788510478.166603:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:11593:x1875388852691712:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:2.0:1788510478.166690:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed661c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.166707:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed661c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.166719:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed661c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.166749:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed661c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.166756:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed661c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.166763:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed661c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.166774:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510478.166784:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed661c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.166792:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed661c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.166804:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:2.0:1788510478.166807:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788510478.166812:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed661c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.166818:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed661c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.166906:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:11593:x1875388852691712:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 305us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510478.166914:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 206 00000100:00100000:0.0:1788510478.172127:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.175552:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852691968 00000100:00100000:1.0:1788510478.175567:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852691968 00000100:00100000:1.0:1788510478.175645:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 58 00000100:00100000:1.0:1788510478.175665:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+54:11593:x1875388852691968:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:1.0:1788510478.175923:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:11593:x1875388852691968:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 260us (3816us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788510478.175930:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 58 00000100:00100000:0.0:1788510478.236179:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510478.236307:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852692224 00000100:00100000:2.0:1788510478.236320:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852692224 00000100:00100000:2.0:1788510478.236407:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 207 00000100:00100000:2.0:1788510478.236418:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:11603:x1875388852692224:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510478.236442:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510478.236445:0:9544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788510478.236474:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73519 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.236505:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:2.0:1788510478.236511:0:9544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788510478.236525:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed661c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7353c expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.236644:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.236658:0:9544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed661b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73535 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.236667:0:9544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.236699:0:9544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed661b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73535 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.236712:0:9544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed661b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73535 expref: 55 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.236725:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeb22d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861070848:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510478.236860:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90db5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788510478.258025:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.258069:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeb22d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861070848:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510478.258118:0:9544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.258253:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852692352 00000100:00100000:0.0:1788510478.258262:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852692352 00010000:00010000:0.0:1788510478.258313:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed661b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73535 expref: 56 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.258358:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 79 00000100:00100000:0.0:1788510478.258368:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:2341:x1875388852692352:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510478.258396:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510478.258402:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed661b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73535 expref: 56 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.258415:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed661b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73535 expref: 56 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.258437:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed661b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73535 expref: 56 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.258468:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:0.0:1788510478.258474:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.258498:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.258508:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.258536:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788510478.258785:0:9544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.258794:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510478.258815:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788510478.258959:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed661c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7353c expref: 57 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.258974:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7353c expref: 56 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.258982:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510478.258985:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788510478.258987:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77a00, rc 0) 00000100:00100000:0.0:1788510478.276310:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+56:2341:x1875388852692352:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 17910us (18263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.276329:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 79 00000100:00100000:1.0:1788510478.279293:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:11603:x1875388852692224:12345-192.168.201.4@tcp:101:bash.0 Request processed in 42852us (43100us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788510478.279306:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 207 00000100:00100000:2.0:1788510478.284033:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.284309:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852692608 00000100:00100000:1.0:1788510478.284325:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852692608 00000100:00100000:1.0:1788510478.284415:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 208 00000100:00100000:1.0:1788510478.284430:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+55:11603:x1875388852692608:12345-192.168.201.4@tcp:36:bash.0 00010000:00010000:1.0:1788510478.284791:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed661de lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.284837:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed661de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.284854:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed661de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788510478.284927:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788510478.284954:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3a8fbd4 reply state 00000000c7899e53 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed661de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.284966:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788510478.285989:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+58:11603:x1875388852692608:12345-192.168.201.4@tcp:36:bash.0 Request processed in 1555us (1964us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788510478.286000:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 208 00000020:00080000:1.0:1788510478.286006:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788510478.293825:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed661de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.293843:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed661de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.293861:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed661de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.293867:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510478.293872:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed661de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.293881:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed661de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.293899:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:3.0:1788510478.293902:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510478.293906:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed661de lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.293912:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed661de lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.294863:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.294937:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852692736 00000100:00100000:3.0:1788510478.294947:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852692736 00000100:00100000:3.0:1788510478.295011:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 209 00000100:00100000:3.0:1788510478.295022:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+57:11603:x1875388852692736:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:3.0:1788510478.295045:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510478.295334:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed661e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73543 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.296940:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.296966:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7353c expref: 58 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.296976:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.297038:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7353c expref: 58 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.297054:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7353c expref: 58 pid: 9544 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.297129:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeb20380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861070976:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510478.297390:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90db5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510478.299922:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeb20380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861070976:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510478.299962:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.306741:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.307508:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852692864 00000100:00100000:1.0:1788510478.307520:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852692864 00010000:00010000:1.0:1788510478.307564:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7353c expref: 59 pid: 9544 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.307612:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 80 00000100:00100000:1.0:1788510478.307623:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+59:2340:x1875388852692864:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510478.307639:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510478.307646:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7353c expref: 59 pid: 9544 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.307660:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7353c expref: 59 pid: 9544 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.307956:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed661d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7353c expref: 59 pid: 9544 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.307975:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510478.307980:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.307990:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.308701:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.308740:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510478.308800:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+58:2340:x1875388852692864:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 1178us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510478.308809:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 80 00010000:00010000:2.0:1788510478.308999:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.309008:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510478.309054:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788510478.309058:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510478.309079:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.309110:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed661e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73543 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.309126:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73543 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.309152:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:2.0:1788510478.309156:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510478.309158:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77800, rc 0) 00000100:00100000:2.0:1788510478.309196:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+57:11603:x1875388852692736:12345-192.168.201.4@tcp:101:bash.0 Request processed in 14176us (14339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510478.309203:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 209 00000100:00100000:2.0:1788510478.313678:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.314494:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852693120 00000100:00100000:1.0:1788510478.314506:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852693120 00000100:00100000:1.0:1788510478.314571:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 59 00000100:00100000:1.0:1788510478.314582:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+57:11603:x1875388852693120:12345-192.168.201.4@tcp:35:bash.0 00000100:00100000:1.0:1788510478.314851:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+58:11603:x1875388852693120:12345-192.168.201.4@tcp:35:bash.0 Request processed in 269us (1182us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788510478.314859:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 59 00000100:00100000:0.0:1788510478.389364:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510478.389474:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852693248 00000100:00100000:2.0:1788510478.389496:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852693248 00000100:00100000:2.0:1788510478.389563:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 210 00000100:00100000:2.0:1788510478.389574:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab50ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+58:11609:x1875388852693248:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510478.389601:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510478.389624:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed661f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7354a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.389869:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed661fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.389885:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed661fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.389897:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed661fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510478.389931:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788510478.389935:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510478.389952:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed661fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.389996:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed661f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7354a expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.390280:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed661fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7354a expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.390290:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:2.0:1788510478.390293:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510478.390297:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76200, rc 0) 00000100:00100000:2.0:1788510478.390355:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab50ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+59:11609:x1875388852693248:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 783us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510478.390362:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 210 00000100:00100000:0.0:1788510478.401387:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.401540:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852693376 00000100:00100000:1.0:1788510478.401550:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852693376 00000100:00100000:1.0:1788510478.401633:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 211 00000100:00100000:1.0:1788510478.401667:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+59:11609:x1875388852693376:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510478.401689:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510478.401710:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66201 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73551 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.401772:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66208 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.401787:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.401798:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.401812:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6620f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.401820:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6620f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.401826:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6620f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.401917:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.401926:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.401933:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510478.401976:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788510478.401980:0:9544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510478.402008:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402027:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402036:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402042:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66208 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402049:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402055:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510478.402059:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402066:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66208 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402078:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:1.0:1788510478.402081:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510478.402085:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402092:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402126:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6620f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402132:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6620f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402138:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6620f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402151:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510478.402154:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6620f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402160:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6620f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402167:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a82b92100) 00010000:00010000:1.0:1788510478.402170:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510478.402172:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6620f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402178:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033200/0x3e734462ed6620f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402212:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66201 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73551 expref: 61 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402256:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73551 expref: 60 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.402277:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510478.402280:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788510478.402282:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032000, rc 0) 00000100:00100000:1.0:1788510478.402414:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:11609:x1875388852693376:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 749us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510478.402422:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 211 00000100:00100000:0.0:1788510478.406724:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.406770:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.406926:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852693632 00000100:00100000:1.0:1788510478.406936:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852693632 00000100:00100000:1.0:1788510478.407001:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 212 00000100:00100000:1.0:1788510478.407011:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a87e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:11609:x1875388852693632:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510478.407033:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510478.407053:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed6621d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73558 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.407166:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.407182:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73543 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.407191:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73551 expref: 61 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.407200:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.407261:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73551 expref: 61 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.407291:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73551 expref: 61 pid: 9544 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.407305:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861071104:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510478.407404:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73543 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.407413:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73543 expref: 61 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.407422:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861071232:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510478.407444:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b33d80 going to sleep for 11 seconds 00010000:00010000:1.0:1788510478.410355:0:5821:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.4@tcp) returned -22 from blocking AST (req@00000000da5075bc x1875388861071104) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73551 expref: 61 pid: 9544 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.410390:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73551 expref: 61 pid: 9544 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.410414:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73551 expref: 61 pid: 9544 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.410429:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861071104:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510478.410443:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1875388861071232:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510478.410467:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510478.410496:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.410505:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.410514:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.410609:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510478.411085:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852693760 00000100:00100000:2.0:1788510478.411093:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852693760 00000100:00100000:3.0:1788510478.411353:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852693888 00000100:00100000:3.0:1788510478.411358:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852693888 00010000:00010000:0.0:1788510478.411433:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73543 expref: 62 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.411464:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 81 00000100:00100000:0.0:1788510478.411484:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+62:2340:x1875388852693888:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510478.411498:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510478.411503:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73543 expref: 62 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.411526:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73543 expref: 62 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.411540:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77800/0x3e734462ed661ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73543 expref: 62 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.411551:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:0.0:1788510478.411555:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.411563:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.411571:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.411598:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510478.411640:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+61:2340:x1875388852693888:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 162us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.411655:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 81 00000100:00100000:0.0:1788510478.411670:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:0.0:1788510478.411676:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:2340:x1875388852693760:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510478.411683:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510478.411685:0:5808:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 3e734462ed66216) 00010000:00010000:0.0:1788510478.411687:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510478.411701:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:2340:x1875388852693760:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 26us (4932us total) trans 0 rc 116/116 00000100:00100000:0.0:1788510478.411715:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 16 00010000:00010000:3.0:1788510478.412067:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.412076:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510478.412093:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788510478.412273:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed6621d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73558 expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.412289:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73558 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.412296:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:3.0:1788510478.412299:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788510478.412301:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033000, rc 0) 00000100:00100000:3.0:1788510478.412332:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a87e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:11609:x1875388852693632:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 5323us (5621us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788510478.412339:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 212 00000100:00100000:0.0:1788510478.414399:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.414466:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852694144 00000100:00100000:1.0:1788510478.414485:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852694144 00000100:00100000:1.0:1788510478.414540:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:1.0:1788510478.414550:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:11609:x1875388852694144:12345-192.168.201.4@tcp:103:lfs.0 00010000:00010000:1.0:1788510478.414564:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510478.414596:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed66183 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7352e expref: 60 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.414614:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510478.414618:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510478.414805:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+59:11609:x1875388852694144:12345-192.168.201.4@tcp:103:lfs.0 Request processed in 255us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510478.414813:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:0.0:1788510478.417433:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.417580:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852694272 00000100:00100000:3.0:1788510478.417594:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852694272 00000100:00100000:3.0:1788510478.417845:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 213 00000100:00100000:3.0:1788510478.417856:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8578f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+59:11609:x1875388852694272:12345-192.168.201.4@tcp:58:lfs.0 00010000:00010000:3.0:1788510478.418005:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.418042:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.418054:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788510478.418342:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788510478.418439:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8578f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+59:11609:x1875388852694272:12345-192.168.201.4@tcp:58:lfs.0 Request processed in 583us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510478.418447:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 213 00000100:00100000:0.0:1788510478.422922:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.422990:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852694400 00000100:00100000:3.0:1788510478.423011:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852694400 00000100:00100000:3.0:1788510478.423081:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 214 00000100:00100000:3.0:1788510478.423091:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+59:11609:x1875388852694400:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:3.0:1788510478.423112:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510478.423132:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed66239 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7355f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.423200:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.423212:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed66239 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7355f expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.423260:0:5822:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.423273:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed66239 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7355f expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.423303:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:3.0:1788510478.423306:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788510478.423310:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed66239 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7355f expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.423319:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69a00, rc 0) 00000100:00100000:3.0:1788510478.423374:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:11609:x1875388852694400:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 285us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510478.423391:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 214 00000040:00080000:3.0:1788510478.468709:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510478.468719:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510478.468774:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788510478.468780:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788510478.468894:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae94ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861071360:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788510478.468987:0:11661:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa51d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788510478.473688:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.473823:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae94ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861071360:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788510478.478679:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852694528 00000100:00100000:1.0:1788510478.478695:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852694528 00000100:00100000:1.0:1788510478.478980:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 215 00000100:00100000:1.0:1788510478.479002:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:11610:x1875388852694528:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788510478.479041:0:9544:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788510478.479168:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:11610:x1875388852694528:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 179us (5490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510478.479191:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 215 00000100:00100000:0.0:1788510478.488847:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.488973:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852694656 00000100:00100000:3.0:1788510478.488984:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852694656 00000100:00100000:3.0:1788510478.489198:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 216 00000100:00100000:3.0:1788510478.489209:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:11610:x1875388852694656:12345-192.168.201.4@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788510478.489581:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66240 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.489599:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66240 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.489610:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66240 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490179:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed66247 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490190:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed66247 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490199:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed66247 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490268:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6624e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490277:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6624e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490285:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6624e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510478.490323:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788510478.490328:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510478.490339:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6624e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490350:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66240 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490357:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66240 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490365:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66240 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490371:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510478.490385:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66240 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490394:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66240 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490405:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:2.0:1788510478.490413:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510478.490418:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66240 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490424:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed66240 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490438:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed66247 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490444:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed66247 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490452:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed66247 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490456:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510478.490458:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed66247 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490464:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed66247 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490471:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff929aac578000) 00010000:00010000:2.0:1788510478.490474:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510478.490476:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed66247 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490483:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76400/0x3e734462ed66247 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490496:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6624e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490507:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6624e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490513:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6624e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490518:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510478.490520:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6624e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490527:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6624e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490534:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:2.0:1788510478.490537:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510478.490539:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6624e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.490544:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6624e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.490692:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:11610:x1875388852694656:12345-192.168.201.4@tcp:34:lhsmtool_posix.0 Request processed in 1482us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510478.490702:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 216 00000100:00100000:0.0:1788510478.503686:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.503772:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852694912 00000100:00100000:3.0:1788510478.503783:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852694912 00000100:00100000:3.0:1788510478.503845:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 217 00000100:00100000:3.0:1788510478.503857:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+60:11610:x1875388852694912:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510478.503893:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510478.503912:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66255 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73566 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504004:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed6625c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504020:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed6625c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504031:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed6625c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510478.504043:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788510478.504145:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed6625c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504153:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed6625c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504160:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed6625c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504166:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510478.504171:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed6625c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504179:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed6625c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504191:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:3.0:1788510478.504199:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788510478.504204:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed6625c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504212:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed6625c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504292:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66255 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73566 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504303:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:3.0:1788510478.504305:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788510478.504309:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66255 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73566 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.504318:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68c00, rc 0) 00000100:00100000:3.0:1788510478.504370:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+61:11610:x1875388852694912:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 515us (694us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788510478.504388:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 217 00000100:00100000:0.0:1788510478.510753:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.510841:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852695040 00000100:00100000:1.0:1788510478.510853:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852695040 00000100:00100000:1.0:1788510478.510917:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 218 00000100:00100000:1.0:1788510478.510928:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+61:11610:x1875388852695040:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788510478.510966:0:5821:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788510478.511094:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+61:11610:x1875388852695040:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 168us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510478.511102:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 218 00000100:00100000:0.0:1788510478.513823:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.513913:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852695296 00000100:00100000:3.0:1788510478.513924:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852695296 00000100:00100000:3.0:1788510478.513987:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 219 00000100:00100000:3.0:1788510478.513999:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a98432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+61:11610:x1875388852695296:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510478.514032:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510478.514035:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788510478.514063:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed661fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7354a expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.514081:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:3.0:1788510478.514098:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788510478.514112:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed6626a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7356d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788510478.514601:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1788510478.514809:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66271 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.514825:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.514858:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.514921:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed6626a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7356d expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.514937:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7356d expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.514944:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eab400) 00010000:00010000:3.0:1788510478.514947:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510478.514949:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69800, rc 0) 00000100:00100000:3.0:1788510478.515006:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a98432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+62:11610:x1875388852695296:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 1009us (1194us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788510478.515013:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 219 00000100:00100000:0.0:1788510478.523409:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.523536:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852695552 00000100:00100000:1.0:1788510478.523546:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852695552 00000100:00100000:1.0:1788510478.523601:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 220 00000100:00100000:1.0:1788510478.523611:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+62:11610:x1875388852695552:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788510478.523667:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510478.523691:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69800/0x3e734462ed66271 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7356d expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523709:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eab400) 00010000:00010000:1.0:1788510478.523719:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788510478.523739:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6627f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523753:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6627f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523763:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6627f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523795:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66286 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf758190b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523803:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf758190b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523810:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf758190b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523869:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6627f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523877:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6627f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523884:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6627f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523890:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510478.523894:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6627f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523902:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6627f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523911:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:1.0:1788510478.523914:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510478.523917:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6627f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523923:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6627f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523938:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf758190b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523944:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66286 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf758190b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523951:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66286 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf758190b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523956:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510478.523958:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66286 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf758190b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523964:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66286 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf758190b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523970:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf758190b (ffff929a82b92100) 00010000:00010000:1.0:1788510478.523973:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510478.523975:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66286 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf758190b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.523980:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66286 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf758190b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.524070:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+61:11610:x1875388852695552:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 460us (672us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788510478.524079:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 220 00000100:00100000:0.0:1788510478.533090:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.533185:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852695680 00000100:00100000:3.0:1788510478.533195:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852695680 00000100:00100000:3.0:1788510478.533282:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 221 00000100:00100000:3.0:1788510478.533294:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+61:11610:x1875388852695680:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510478.533338:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510478.533362:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed6628d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73574 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.533415:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed66294 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.533430:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed66294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.533443:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed66294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.533547:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed6628d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73574 expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.533563:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed66294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73574 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.533571:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:3.0:1788510478.533573:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788510478.533577:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68400, rc 0) 00000100:00100000:3.0:1788510478.533631:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+62:11610:x1875388852695680:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 340us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510478.533638:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 221 00000100:00100000:0.0:1788510478.537155:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.537308:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852695936 00000100:00100000:1.0:1788510478.537318:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852695936 00000100:00100000:1.0:1788510478.537384:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 222 00000100:00100000:1.0:1788510478.537411:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+62:11610:x1875388852695936:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788510478.537506:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6629b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.537527:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6629b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.537541:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6629b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788510478.537790:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:1.0:1788510478.537885:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000585552ae reply state 00000000e3dc789f transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6629b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.537894:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788510478.537989:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+64:11610:x1875388852695936:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 580us (854us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788510478.537996:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 222 00010000:00010000:3.0:1788510478.546952:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6629b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.546972:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6629b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.547009:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6629b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.547023:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510478.547028:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6629b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.547037:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6629b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.547054:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:3.0:1788510478.547057:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788510478.547062:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6629b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.547069:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6629b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.556333:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.556617:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852696064 00000100:00100000:3.0:1788510478.556628:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852696064 00000100:00100000:3.0:1788510478.556678:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 223 00000100:00100000:3.0:1788510478.556689:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+63:11610:x1875388852696064:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510478.556712:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510478.556733:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed662a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7357b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.556798:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed662a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7357b expref: 64 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.556835:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed662a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7357b expref: 64 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.556857:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:3.0:1788510478.556860:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788510478.556864:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68c00, rc 0) 00000100:00100000:3.0:1788510478.556929:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+64:11610:x1875388852696064:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 242us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510478.556936:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 223 00000100:00100000:0.0:1788510478.565456:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510478.565584:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852696192 00000100:00100000:2.0:1788510478.565597:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852696192 00000100:00100000:2.0:1788510478.565658:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 62 00000100:00100000:2.0:1788510478.565669:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2341:x1875388852696192:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788510478.565984:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:2341:x1875388852696192:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 Request processed in 316us (543us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788510478.566023:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 62 00000100:00100000:0.0:1788510478.589819:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.589927:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852696448 00000100:00100000:1.0:1788510478.589940:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852696448 00000100:00100000:1.0:1788510478.590013:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 60 00000100:00100000:1.0:1788510478.590033:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+64:11610:x1875388852696448:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788510478.590339:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+65:11610:x1875388852696448:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 309us (531us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788510478.590348:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 60 00000100:00100000:3.0:1788510478.593705:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.594116:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852696704 00000100:00100000:1.0:1788510478.594126:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852696704 00000100:00100000:1.0:1788510478.594279:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 224 00000100:00100000:1.0:1788510478.594289:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+65:11610:x1875388852696704:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788510478.594413:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+65:11610:x1875388852696704:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 125us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510478.594422:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 224 00010000:00010000:3.0:1788510478.596989:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510478.597869:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510478.598961:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852696832 00000100:00100000:2.0:1788510478.598974:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852696832 00000100:00100000:0.0:1788510478.599286:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 225 00000100:00100000:0.0:1788510478.599299:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+65:11610:x1875388852696832:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788510478.599321:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510478.599343:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed662a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73582 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.599424:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.599438:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.599467:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510478.599502:0:9544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788510478.599519:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.599543:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafe00/0x3e734462ed662a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73582 expref: 67 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.599559:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73582 expref: 66 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.599568:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:0.0:1788510478.599571:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788510478.599574:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf000, rc 0) 00000100:00100000:0.0:1788510478.599639:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+66:11610:x1875388852696832:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 344us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.599645:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 225 00000100:00100000:0.0:1788510478.608865:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.608969:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852696960 00000100:00100000:3.0:1788510478.608979:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852696960 00000100:00100000:3.0:1788510478.609051:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 63 00000100:00100000:3.0:1788510478.609062:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+10:2340:x1875388852696960:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510478.609081:0:12047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510478.609102:0:12047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed662b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73589 expref: -99 pid: 12047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788510478.609129:0:12047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a810e, blocks: 0x1 00010000:00010000:3.0:1788510478.609157:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1788510478.609162:0:12047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788510478.609171:0:12047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed662b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73589 expref: 11 pid: 12047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.609211:0:12047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed662b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73589 expref: 11 pid: 12047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.609476:0:12047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69600, rc 0) 00000100:00100000:3.0:1788510478.609552:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:2340:x1875388852696960:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 491us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510478.609560:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 63 00000100:00100000:2.0:1788510478.615725:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.615801:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852697216 00000100:00100000:0.0:1788510478.615811:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852697216 00000100:00100000:0.0:1788510478.615868:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 226 00000100:00100000:0.0:1788510478.615878:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+66:11610:x1875388852697216:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788510478.615985:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+66:11610:x1875388852697216:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.616002:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 226 00000100:00100000:0.0:1788510478.636025:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510478.636146:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852697344 00000100:00100000:2.0:1788510478.636156:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852697344 00000100:00100000:2.0:1788510478.636216:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 64 00000100:00100000:2.0:1788510478.636245:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:11610:x1875388852697344:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788510478.636264:0:8183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510478.636295:0:8183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73590 expref: -99 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.636328:0:8183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed662b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73589 expref: 12 pid: 12047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.636337:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510478.636342:0:8183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510478.636347:0:8183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 12 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.636527:0:8183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed662b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73589 expref: 12 pid: 12047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.636542:0:8183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed662b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73589 expref: 12 pid: 12047 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.636578:0:8183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8183:1875388861071488:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510478.636666:0:8183:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90db5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510478.647686:0:8183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeb23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8183:1875388861071488:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510478.647746:0:8183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 12 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.647771:0:8183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76400, rc 0) 00000100:00100000:2.0:1788510478.647956:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+12:11610:x1875388852697344:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 11620us (11830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510478.647967:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 64 00000100:00100000:3.0:1788510478.650348:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.650478:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852697472 00000100:00100000:0.0:1788510478.650490:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852697472 00010000:00010000:0.0:1788510478.650536:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed662b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73589 expref: 12 pid: 12047 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.650587:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 82 00000100:00100000:0.0:1788510478.650599:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+12:2340:x1875388852697472:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510478.650614:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510478.650637:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed662b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73589 expref: 12 pid: 12047 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.650652:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed662b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73589 expref: 12 pid: 12047 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.650679:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be67033/0x3e734462ed662b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73589 expref: 12 pid: 12047 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.650698:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510478.650702:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510478.650712:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 11 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.650723:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 11 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.650764:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 11 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.650793:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1875388861071616:192.168.201.4@tcp:105: 00000100:00100000:0.0:1788510478.650885:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a83095600 going to sleep for 11 seconds 00000100:00100000:3.0:1788510478.669577:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.669809:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1875388861071616:192.168.201.4@tcp:105: 00010000:00010000:0.0:1788510478.669832:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510478.669896:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:2340:x1875388852697472:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 19299us (19558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.669907:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 82 00000100:00100000:2.0:1788510478.671860:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852697600 00000100:00100000:2.0:1788510478.671875:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852697600 00002000:00100000:2.0:1788510478.671931:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff929ab7dd6d80 x1875388852697600/t0(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:49/0 lens 504/0 e 0 to 0 dl 1788510489 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788510478.671943:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929ab7dd6d80 with x1875388852697600 ext(0->12) 00002000:00010000:2.0:1788510478.671949:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929ab7dd6d80 00000100:00100000:2.0:1788510478.671985:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:2.0:1788510478.671994:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+11:2341:x1875388852697600:12345-192.168.201.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788510478.672472:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2341:x1875388852697600:12345-192.168.201.4@tcp:4:lhsmtool_posix.0 Request processed in 477us (2904us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788510478.672480:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 6 00002000:00100000:2.0:1788510478.672487:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff929ab7dd6d80 x1875388852697600/t4294967320(0) o4->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:49/0 lens 504/448 e 0 to 0 dl 1788510489 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788510478.672501:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929ab7dd6d80 with x1875388852697600 ext(0->12) 00002000:00010000:2.0:1788510478.672504:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929ab7dd6d80 00000100:00100000:3.0:1788510478.677357:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.677435:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852697728 00000100:00100000:1.0:1788510478.677447:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852697728 00000100:00100000:1.0:1788510478.677513:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 227 00000100:00100000:1.0:1788510478.677523:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+66:11610:x1875388852697728:12345-192.168.201.4@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788510478.776443:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+66:11610:x1875388852697728:12345-192.168.201.4@tcp:44:lhsmtool_posix.0 Request processed in 98906us (99079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510478.776458:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 227 00000001:00080000:3.0:1788510478.777118:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967481 is committed 00000004:00080000:3.0:1788510478.777124:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788510478.777148:0:5843:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92998183f600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788510478.777152:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929aaee72b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92998183f0c0 00000020:00080000:3.0:1788510478.777156:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929aaee72600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff929a82c30800 00000001:00080000:3.0:1788510478.777178:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788510478.777259:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788510478.777270:0:5843:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff929abaa513c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788510478.777272:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929a9e060a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff929abaa51180 00000020:00080000:3.0:1788510478.777274:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929a9e060400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff929ab7c81400 00000020:00080000:3.0:1788510478.777324:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1788510478.777609:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861071744:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788510478.777670:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788510478.777673:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788510478.777731:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788510478.777738:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861071872:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788510478.777762:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510478.777805:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861071744 00000100:00100000:0.0:1788510478.777811:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861071744 00000100:00100000:3.0:1788510478.777851:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861071872 00000100:00100000:3.0:1788510478.777855:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861071872 00000100:00100000:0.0:1788510478.777875:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788510478.777880:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788510478.777884:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861071744:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788510478.777885:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861071872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788510478.777906:0:6667:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00080000:0.0:1788510478.777906:0:6669:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788510478.777927:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788510478.777934:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9a810d, atime: 0x6a9a810d, ctime: 0x6a9a810d, blocks: 0x1 00010000:00010000:3.0:1788510478.777939:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9ec9d7b/0x3e734462ed662cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.777947:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb06f87b/0x3e734462ed66087 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734ef expref: 12 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.777948:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1788510478.777953:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788510478.777955:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788510478.777959:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ec9d7b/0x3e734462ed662cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.777964:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788510478.777974:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.777976:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9ec9d7b/0x3e734462ed662cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.778002:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb06f87b/0x3e734462ed66087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734ef expref: 12 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.778017:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb06f87b/0x3e734462ed66087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734ef expref: 12 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.778029:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1875388861072000:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510478.778088:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a83095900 going to sleep for 11 seconds 00000100:00080000:0.0:1788510478.778101:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788510478.778898:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9ec9d7b/0x3e734462ed662cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.778913:0:6667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ec9d7b/0x3e734462ed662cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.778939:0:6667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788510478.778998:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00010000:00010000:2.0:1788510478.779078:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510478.779087:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9ec9d7b/0x3e734462ed662cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.779093:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852697856 00010000:00010000:2.0:1788510478.779095:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69c00 already unused, calling callback (ffffffffc15884f0) 00000100:00100000:1.0:1788510478.779100:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852697856 00010000:00010000:2.0:1788510478.779101:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9ec9d7b/0x3e734462ed662cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.779112:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9ec9d7b/0x3e734462ed662cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.779132:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9ec9d7b/0x3e734462ed662cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.779141:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9ec9d7b/0x3e734462ed662cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.779166:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510478.779168:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510478.779169:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510478.779186:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 67 00000100:00100000:1.0:1788510478.779197:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2340:x1875388852697856:12345-192.168.201.4@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788510478.780000:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3290:x1875388861071872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2109us (2232us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788510478.780017:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1788510478.780173:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929abae6a300/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788510478.780181:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861071872:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788510478.780680:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1875388861072000:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510478.780712:0:6669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.781145:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.781443:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852697984 00000100:00100000:3.0:1788510478.781450:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852697984 00010000:00010000:3.0:1788510478.781494:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb06f87b/0x3e734462ed66087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734ef expref: 14 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510478.781530:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 83 00000100:00100000:3.0:1788510478.781539:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+14:2341:x1875388852697984:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510478.781553:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510478.781559:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb06f87b/0x3e734462ed66087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734ef expref: 14 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.781570:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb06f87b/0x3e734462ed66087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734ef expref: 14 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.781590:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb06f87b/0x3e734462ed66087 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734ef expref: 14 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.781606:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788510478.781610:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788510478.781615:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.781625:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.781924:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510478.781971:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+13:2341:x1875388852697984:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 433us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510478.781976:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 83 00010000:00010000:3.0:1788510478.781998:0:6669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.782005:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.782011:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.782016:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.782026:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788510478.782575:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3290:x1875388861071744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4690us (4904us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788510478.782583:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1788510478.782604:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510478.782610:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.782618:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf400 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510478.782632:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.782640:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.782653:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.782660:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cdd57a6/0x3e734462ed662c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.782677:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510478.782679:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510478.782681:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788510478.782715:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929abae68000/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788510478.782739:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861071744:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788510478.820310:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1788510478.820333:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:0.0:1788510478.820767:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852697856:12345-192.168.201.4@tcp:16:lhsmtool_posix.0 Request processed in 41553us (41752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.820780:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 67 00000100:00100000:2.0:1788510478.823472:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.823630:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852698240 00000100:00100000:0.0:1788510478.823641:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852698240 00000100:00100000:0.0:1788510478.823738:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 228 00000100:00100000:0.0:1788510478.823750:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11610:x1875388852698240:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788510478.823816:0:9544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510478.823848:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73582 expref: 20 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.823870:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:0.0:1788510478.823889:0:9544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510478.823921:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.823935:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.823946:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510478.824197:0:9544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7386e0e reply state 00000000815302c8 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.824208:0:9544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788510478.824364:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:11610:x1875388852698240:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 616us (902us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788510478.824389:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 228 00000100:00100000:2.0:1788510478.827602:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.827651:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852698368 00000100:00100000:0.0:1788510478.827663:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852698368 00000100:00100000:0.0:1788510478.827774:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 68 00000100:00100000:0.0:1788510478.827784:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2341:x1875388852698368:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1788510478.827863:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.827877:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.827885:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.827891:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafa00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510478.827916:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.827926:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.827950:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:3.0:1788510478.827953:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510478.827959:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.827965:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788510478.828044:0:12047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788510478.828048:0:12047:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788510478 00002000:00010000:0.0:1788510478.828051:0:12047:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788510477 00002000:00010000:0.0:1788510478.828054:0:12047:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788510478 -> 1788510478 00002000:00010000:0.0:1788510478.828056:0:12047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788510478.828121:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2341:x1875388852698368:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 Request processed in 337us (531us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788510478.828129:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 68 00000100:00100000:3.0:1788510478.830299:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510478.830437:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852698624 00000100:00100000:2.0:1788510478.830457:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852698624 00000100:00100000:2.0:1788510478.830513:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 229 00000100:00100000:2.0:1788510478.830522:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11610:x1875388852698624:12345-192.168.201.4@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788510478.830586:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.830601:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed66294 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73574 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.830611:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.830648:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed66294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73574 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.830662:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed66294 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73574 expref: 20 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.830675:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeb22300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861072128:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510478.830760:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510478.834045:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.834117:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeb22300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1875388861072128:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510478.834138:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.834253:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852698752 00000100:00100000:0.0:1788510478.834260:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852698752 00010000:00010000:0.0:1788510478.834303:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed66294 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73574 expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.834333:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 84 00000100:00100000:0.0:1788510478.834341:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:2341:x1875388852698752:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510478.834353:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510478.834358:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed66294 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73574 expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.834366:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed66294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73574 expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.834397:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68400/0x3e734462ed66294 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73574 expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.834412:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:0.0:1788510478.834418:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.834428:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.834436:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.834467:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788510478.834952:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.834961:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.834991:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.835070:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.835078:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.835084:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510478.835088:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.835096:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.835107:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:2.0:1788510478.835110:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788510478.835114:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.835119:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed662da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.835435:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:11610:x1875388852698624:12345-192.168.201.4@tcp:55:lhsmtool_posix.0 Request processed in 4912us (5143us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788510478.835445:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 229 00000100:00100000:0.0:1788510478.835660:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:2341:x1875388852698752:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 1318us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.835677:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 84 00000100:00100000:0.0:1788510478.839624:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.839728:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852698880 00000100:00100000:3.0:1788510478.839743:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852698880 00000100:00100000:3.0:1788510478.839823:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 69 00000100:00100000:3.0:1788510478.839837:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2340:x1875388852698880:12345-192.168.201.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788510478.839890:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.839913:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 8 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.839922:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788510478.839941:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788510478.839946:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.839983:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 8 pid: 8183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510478.839997:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 8 pid: 8183 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510478.840014:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7dd0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1875388861072256:192.168.201.4@tcp:104: 00000100:00100000:3.0:1788510478.840104:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aa1701540 going to sleep for 11 seconds 00000100:00100000:1.0:1788510478.849908:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.850135:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7dd0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1875388861072256:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510478.850173:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.850359:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852699008 00000100:00100000:0.0:1788510478.850367:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852699008 00010000:00010000:1.0:1788510478.850500:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 9 pid: 8183 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.850574:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 85 00000100:00100000:1.0:1788510478.850584:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+9:2341:x1875388852699008:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510478.850601:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510478.850646:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 9 pid: 8183 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.850659:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 9 pid: 8183 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.850681:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d06c74ca/0x3e734462ed662be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73590 expref: 9 pid: 8183 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.850697:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788510478.850701:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788510478.850707:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.850717:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.850749:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510478.850883:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.850893:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.850916:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.850925:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.850933:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.850941:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68a00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:0.0:1788510478.850945:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.850954:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.850978:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.850987:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007679c990/0x3e734462ed662e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.851048:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2341:x1875388852699008:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 464us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510478.851055:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 85 00000100:00100000:0.0:1788510478.851660:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2340:x1875388852698880:12345-192.168.201.4@tcp:1:lhsmtool_posix.0 Request processed in 11825us (12047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.851670:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 69 00000100:00100000:2.0:1788510478.860984:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.861090:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852699264 00000100:00100000:0.0:1788510478.861104:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852699264 00000100:00100000:0.0:1788510478.861179:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 230 00000100:00100000:0.0:1788510478.861191:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11610:x1875388852699264:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788510478.861338:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.861362:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.861387:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.861657:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.861669:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed662a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7357b expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.861702:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.861743:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed662a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7357b expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.861761:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed662a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7357b expref: 20 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.861777:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861072384:192.168.201.4@tcp:104: 00000100:00100000:0.0:1788510478.861874:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a83095600 going to sleep for 11 seconds 00000100:00100000:0.0:1788510478.864389:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861072384:192.168.201.4@tcp:104: 00010000:00010000:0.0:1788510478.864427:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.867786:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.872293:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852699392 00000100:00100000:0.0:1788510478.872314:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852699392 00010000:00010000:0.0:1788510478.872388:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed662a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7357b expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.872502:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 86 00000100:00100000:0.0:1788510478.872512:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:2340:x1875388852699392:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510478.872531:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510478.872539:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed662a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7357b expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.872576:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed662a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7357b expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.872598:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed662a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7357b expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.872620:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:0.0:1788510478.872626:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.872637:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.872646:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.872683:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510478.872748:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:2340:x1875388852699392:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 237us (4976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.872755:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 86 00010000:00010000:2.0:1788510478.873107:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.873118:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788510478.873455:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788510478.873640:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788510478.873689:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788510478.873787:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeb23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1875388861072512:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788510478.873858:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510478.873893:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aa15c69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510478.878425:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861072512 00000100:00100000:0.0:1788510478.878448:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861072512 00000100:00100000:0.0:1788510478.879047:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788510478.879069:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1875388861072512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788510478.879266:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1875388861072512:12345-0@lo:1000:mdt00_001.0 Request processed in 206us (5407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.879274:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788510478.879398:0:5822:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1788510478.879405:0:5822:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1788510478.879436:0:5822:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff929abae68000 x1875388861071744/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788510494 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510478.879451:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeb23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1875388861072512:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788510478.879976:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788510478.880064:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeb23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1875388861072640:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788510478.880134:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510478.880855:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510478.880959:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861072640 00000100:00100000:1.0:1788510478.880967:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861072640 00000100:00100000:1.0:1788510478.881013:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788510478.881025:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1875388861072640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788510478.881290:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5822:x1875388861072640:12345-0@lo:1000:mdt00_001.0 Request processed in 267us (1155us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788510478.881312:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788510478.881430:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeb23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1875388861072640:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788510478.881470:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881482:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881491:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881498:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510478.881503:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881517:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881533:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:2.0:1788510478.881537:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788510478.881543:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881549:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed662ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881582:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881588:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881594:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881600:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510478.881603:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881608:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881950:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:2.0:1788510478.881954:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788510478.881962:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed66239 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7355f expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881985:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed66239 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7355f expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.881994:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed66239 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7355f expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.882029:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed66239 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7355f expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.882042:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeb23100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861072768:192.168.201.4@tcp:105: 00000100:00100000:2.0:1788510478.882202:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510478.886090:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.886602:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeb23100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1875388861072768:192.168.201.4@tcp:105: 00010000:00010000:0.0:1788510478.886644:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886658:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68200/0x3e734462ed66232 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886703:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed662f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886719:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed662f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886732:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed662f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886744:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed662f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886751:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed662f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886758:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed662f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886764:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510478.886768:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed662f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886777:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed662f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886788:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:0.0:1788510478.886805:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510478.886810:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed662f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886816:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed662f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886827:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886834:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886839:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886849:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafa00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510478.886853:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886859:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886867:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:0.0:1788510478.886869:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788510478.886872:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.886889:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed662e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.887170:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:11610:x1875388852699264:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 25979us (26196us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788510478.887191:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 230 00000020:00080000:0.0:1788510478.887198:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788510478.887314:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510478.887319:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788510478.887722:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852699520 00000100:00100000:1.0:1788510478.887731:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852699520 00000040:00080000:3.0:1788510478.887798:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788510478.887805:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788510478.887834:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 61 00000100:00100000:1.0:1788510478.887845:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:11609:x1875388852699520:12345-192.168.201.4@tcp:49:lfs.0 00000100:00100000:1.0:1788510478.887981:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+23:11609:x1875388852699520:12345-192.168.201.4@tcp:49:lfs.0 Request processed in 138us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510478.887988:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 61 00000100:00100000:2.0:1788510478.893343:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510478.893396:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510478.893417:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852699776 00000100:00100000:3.0:1788510478.893428:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852699776 00000100:00100000:0.0:1788510478.893569:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852700032 00000100:00100000:0.0:1788510478.893573:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852700032 00000100:00100000:2.0:1788510478.893575:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 231 00000100:00100000:2.0:1788510478.893587:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:11609:x1875388852699776:12345-192.168.201.4@tcp:58:lfs.0 00000100:00100000:0.0:1788510478.893607:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 62 00000100:00100000:0.0:1788510478.893613:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+24:11610:x1875388852700032:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1788510478.893973:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000004:00080000:0.0:1788510478.894138:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1788510478.894267:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:11609:x1875388852699776:12345-192.168.201.4@tcp:58:lfs.0 Request processed in 681us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510478.894276:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 231 00000001:00080000:0.0:1788510478.894298:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788510478.894343:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed662fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.894362:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed662fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.894383:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed662fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.894392:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed662fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.894399:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed662fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.894405:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed662fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.894429:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510478.894462:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510478.894470:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed662fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.894478:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae400 already unused, calling callback (ffffffffc15884f0) 00000100:00100000:0.0:1788510478.894489:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:11610:x1875388852700032:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 876us (1092us total) trans 4294967514 rc 0/0 00010000:00010000:2.0:1788510478.894492:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed662fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510478.894496:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 62 00010000:00010000:2.0:1788510478.894504:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed662fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788510478.894504:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788510478.894521:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff929a8b8f5c00) 00010000:00010000:2.0:1788510478.894524:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788510478.894528:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed662fd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.894535:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae400/0x3e734462ed662fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510478.894551:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510478.894553:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510478.894554:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510478.928598:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.932112:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852700160 00000100:00100000:1.0:1788510478.932132:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852700160 00000100:00100000:1.0:1788510478.932298:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 232 00000100:00100000:1.0:1788510478.932310:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+25:11612:x1875388852700160:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510478.932337:0:9544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510478.932359:0:9544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed66304 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73597 expref: -99 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.932451:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6630b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.932465:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6630b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.932475:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6630b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.932487:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.932508:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.932513:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.932766:0:9544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.932773:0:9544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73558 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.932780:0:9544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.932816:0:9544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73558 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.932826:0:9544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73558 expref: 26 pid: 5821 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.932837:0:9544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861072896:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510478.932928:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b33d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510478.936798:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510478.937114:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852700416 00000100:00100000:0.0:1788510478.937124:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852700416 00000100:00100000:0.0:1788510478.937193:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 63 00000100:00100000:0.0:1788510478.937205:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:5582:x1875388852700416:12345-192.168.201.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788510478.937583:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:5582:x1875388852700416:12345-192.168.201.4@tcp:35:ldlm_bl.0 Request processed in 380us (800us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788510478.937592:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 63 00000100:00100000:1.0:1788510478.937978:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9544:1875388861072896:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510478.938012:0:9544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510478.939513:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510478.939624:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852700544 00000100:00100000:1.0:1788510478.939651:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852700544 00010000:00010000:1.0:1788510478.939695:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73558 expref: 28 pid: 5821 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510478.939746:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 87 00000100:00100000:1.0:1788510478.939758:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:2341:x1875388852700544:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510478.939776:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510478.939782:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73558 expref: 28 pid: 5821 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.939796:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73558 expref: 28 pid: 5821 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.939820:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66224 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73558 expref: 28 pid: 5821 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.939850:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510478.939855:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.939868:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.939876:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510478.939908:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510478.939962:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:2341:x1875388852700544:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 206us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510478.939977:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 87 00010000:00010000:0.0:1788510478.940395:0:9544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940405:0:9544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510478.940455:0:9544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788510478.940460:0:9544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788510478.940484:0:9544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940498:0:9544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940508:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6630b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940516:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6630b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940522:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6630b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940528:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510478.940543:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6630b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940552:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6630b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940563:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:0.0:1788510478.940566:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510478.940571:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6630b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940577:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6630b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940590:0:9544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940597:0:9544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66312 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940603:0:9544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940607:0:9544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510478.940610:0:9544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940616:0:9544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66312 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940625:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff929a82b92700) 00010000:00010000:0.0:1788510478.940627:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510478.940637:0:9544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66312 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940643:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66312 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940686:0:9544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed66304 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73597 expref: 27 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940711:0:9544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73597 expref: 26 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510478.940718:0:9544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:0.0:1788510478.940720:0:9544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788510478.940722:0:9544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033400, rc 0) 00000100:00100000:0.0:1788510478.940770:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:11612:x1875388852700160:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 8463us (12184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510478.940778:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 232 00000100:00100000:0.0:1788510479.044744:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788510479.045824:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab4e9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861073024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788510479.045961:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510479.053489:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861073024 00000100:00100000:1.0:1788510479.053513:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861073024 00000100:00100000:1.0:1788510479.053679:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788510479.053693:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875388861073024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788510479.053728:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510479.053832:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875388861073024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (7871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510479.053848:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788510479.053957:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab4e9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861073024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788510479.620537:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788510479.888474:0:12595:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788510479.888486:0:12595:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788510479.888536:0:12595:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788510479.888543:0:12595:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788510479.942512:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510479.942521:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510479.942628:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788510479.942634:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788510479.943122:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeb20e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861073152:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788510479.946810:0:11661:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90e2c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510479.954940:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeb20e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875388861073152:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788510479.957516:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510479.961799:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852700672 00000100:00100000:2.0:1788510479.961816:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852700672 00000100:00100000:2.0:1788510479.963645:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 233 00000100:00100000:2.0:1788510479.963662:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:11624:x1875388852700672:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788510479.963709:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788510479.963826:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:11624:x1875388852700672:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 168us (6320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510479.963834:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 233 00000100:00080000:0.0:1788510479.965218:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510479.968800:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510479.969043:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852700928 00000100:00100000:1.0:1788510479.969053:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852700928 00000100:00100000:1.0:1788510479.969108:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 234 00000100:00100000:1.0:1788510479.969118:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+26:11624:x1875388852700928:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788510479.969139:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510479.969162:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66320 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7359e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.969285:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66327 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.969302:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.969315:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510479.969333:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788510479.969465:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66320 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7359e expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.969482:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7359e expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.969490:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510479.969493:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788510479.969497:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033e00, rc 0) 00000100:00100000:1.0:1788510479.969551:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:11624:x1875388852700928:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 434us (762us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788510479.969559:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 234 00000100:00100000:1.0:1788510479.990940:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510479.991098:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852701056 00000100:00100000:3.0:1788510479.991108:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852701056 00000100:00100000:3.0:1788510479.991173:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:3.0:1788510479.991183:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:2343:x1875388852701056:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510479.991199:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510479.991243:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed66327 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7359e expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510479.991261:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:3.0:1788510479.991266:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510479.991327:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:2343:x1875388852701056:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 146us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510479.991333:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:1.0:1788510479.991602:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510479.991625:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852701312 00000100:00100000:1.0:1788510479.991630:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852701312 00000100:00100000:1.0:1788510479.991658:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 235 00000100:00100000:1.0:1788510479.991665:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+27:11624:x1875388852701312:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788510479.991749:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66335 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.991764:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.991776:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.992154:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.992163:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66335 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.992170:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66335 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.992177:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510479.992181:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66335 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.992189:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66335 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.992199:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:1.0:1788510479.992203:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788510479.992207:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66335 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510479.992213:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66335 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510479.992515:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:11624:x1875388852701312:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 848us (912us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788510479.992524:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 235 00000040:00080000:3.0:1788510479.993203:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510479.993208:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510479.994508:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788510479.994523:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788510479.996950:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510479.997111:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852701568 00000100:00100000:1.0:1788510479.997120:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852701568 00000100:00100000:1.0:1788510479.997180:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 64 00000100:00100000:1.0:1788510479.997200:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+28:11624:x1875388852701568:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788510479.997959:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+29:11624:x1875388852701568:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 757us (1015us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788510479.998152:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 64 00000100:00100000:3.0:1788510480.487610:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510480.487656:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510480.487696:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510480.487774:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852701824 00000100:00100000:0.0:1788510480.487785:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852701824 00000100:00100000:1.0:1788510480.487841:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852702080 00000100:00100000:1.0:1788510480.487845:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852702080 00000100:00100000:0.0:1788510480.487853:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 99 00000100:00100000:0.0:1788510480.487863:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2342:x1875388852701824:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510480.487876:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 169 00000100:00100000:1.0:1788510480.487883:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2342:x1875388852702080:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510480.487934:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2342:x1875388852702080:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 52us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510480.487941:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 169 00000100:00080000:3.0:1788510480.488134:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788510480.488150:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510480.490758:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852701696 00000100:00100000:2.0:1788510480.490774:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852701696 00000100:00100000:2.0:1788510480.490844:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 300 00000100:00100000:2.0:1788510480.490855:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2343:x1875388852701696:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510480.490915:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2343:x1875388852701696:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 61us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510480.490923:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 300 00000100:00100000:2.0:1788510480.491020:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510480.491116:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852701952 00000100:00100000:0.0:1788510480.491134:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852701952 00000100:00080000:2.0:1788510480.491799:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788510480.491805:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 100 00000100:00100000:0.0:1788510480.491816:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2343:x1875388852701952:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510480.491843:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2342:x1875388852701824:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 3981us (4185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510480.491850:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2343:x1875388852701952:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 38us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510480.491851:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 99 00000100:00100000:0.0:1788510480.491856:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 100 00010000:00010000:2.0:1788510480.647175:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510481.092576:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abac0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861073664:0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.092646:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510481.092714:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788510481.092721:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861073280:0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.092750:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510481.092770:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861073792:0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.092794:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510481.092822:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861073536:0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.092845:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510481.092863:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788510481.092868:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861073408:0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.092890:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510481.092903:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861073920:0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.092919:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510481.092948:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861073664 00000100:00100000:0.0:1788510481.092956:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861073664 00000100:00100000:0.0:1788510481.093008:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861073920 00000100:00100000:0.0:1788510481.093011:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861073920 00000100:00100000:0.0:1788510481.093035:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788510481.093044:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1875388861073664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.093099:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1875388861073664:12345-0@lo:400:kworker.0 Request processed in 56us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510481.093107:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788510481.093124:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788510481.093130:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861073920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.093251:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861073920:12345-0@lo:400:kworker.0 Request processed in 120us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510481.093257:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788510481.093276:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861073792 00000100:00100000:0.0:1788510481.093280:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861073792 00000100:00100000:0.0:1788510481.093305:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861073536 00000100:00100000:0.0:1788510481.093307:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861073536 00000100:00100000:0.0:1788510481.093319:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861073408 00000100:00100000:0.0:1788510481.093320:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861073408 00000100:00100000:0.0:1788510481.093342:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788510481.093348:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861073792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.093377:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861073792:12345-0@lo:400:kworker.0 Request processed in 30us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510481.093383:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788510481.093392:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788510481.093397:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861073536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.093422:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861073536:12345-0@lo:400:kworker.0 Request processed in 24us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510481.093428:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788510481.093437:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788510481.093442:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861073408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.093477:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861073408:12345-0@lo:400:kworker.0 Request processed in 35us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510481.093482:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1788510481.093498:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788510481.093503:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788510481.093505:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510481.093539:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861073408:0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.093549:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861073920:0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.093557:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861073536:0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.093585:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861073792:0@lo:400:kworker.0 00000100:00100000:0.0:1788510481.093593:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abac0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861073664:0@lo:400:kworker.0 00000100:00100000:3.0:1788510481.094031:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861073280 00000100:00100000:3.0:1788510481.094036:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861073280 00000100:00100000:3.0:1788510481.094074:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788510481.094082:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861073280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510481.094124:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3288:x1875388861073280:12345-0@lo:400:kworker.0 Request processed in 43us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510481.094131:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788510481.094174:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861073280:0@lo:400:kworker.0 00000004:00080000:1.0:1788510481.604598:0:8022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339423371852ns, next at 340423369631ns, rc = 0 00000100:00100000:1.0:1788510481.604628:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788510481.604651:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861074048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788510481.604746:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510481.604819:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861074048 00000100:00100000:1.0:1788510481.604829:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861074048 00000100:00100000:1.0:1788510481.604887:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788510481.604897:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3290:x1875388861074048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788510481.604936:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510481.604994:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3290:x1875388861074048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510481.605001:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788510481.605068:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861074048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788510481.674218:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788510481.736767:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788510481.736789:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788510481.736796:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:3.0:1788510482.086804:0:12650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788510482.086816:0:12650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788510482.086863:0:12650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788510482.086869:0:12650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788510482.320622:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510482.320733:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852702336 00000100:00100000:0.0:1788510482.320744:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852702336 00000100:00100000:0.0:1788510482.320841:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 236 00000100:00100000:0.0:1788510482.320854:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+29:11644:x1875388852702336:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:0.0:1788510482.320881:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510482.320902:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6633c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc735a5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510482.321013:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66343 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510482.321031:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66343 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510482.321046:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66343 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510482.321073:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788510482.321262:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed6633c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735a5 expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510482.321280:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66343 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735a5 expref: 31 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510482.321288:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:0.0:1788510482.321291:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788510482.321295:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae200, rc 0) 00000100:00100000:0.0:1788510482.321369:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:11644:x1875388852702336:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 518us (756us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788510482.321377:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 236 00000100:00080000:2.0:1788510482.321701:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510482.326590:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510482.326676:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852702464 00000100:00100000:2.0:1788510482.326686:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852702464 00000100:00100000:2.0:1788510482.326751:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 237 00000100:00100000:2.0:1788510482.326764:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:11644:x1875388852702464:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:2.0:1788510482.326830:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66351 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510482.326849:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510482.326861:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510482.326889:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510482.326910:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66351 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510482.326916:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510482.326923:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510482.326940:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510482.326949:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66351 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510482.326961:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:2.0:1788510482.326965:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788510482.326970:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66351 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510482.326977:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77a00/0x3e734462ed66351 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510482.327053:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+31:11644:x1875388852702464:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 290us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510482.327061:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 237 00000100:00100000:0.0:1788510482.413559:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510482.413721:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852702592 00000100:00100000:1.0:1788510482.413731:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852702592 00000100:00100000:1.0:1788510482.413839:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 70 00000100:00100000:1.0:1788510482.413850:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2343:x1875388852702592:12345-192.168.201.4@tcp:101:cat.0 00010000:00010000:1.0:1788510482.413867:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510482.413897:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed66358 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc735ac expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788510482.413929:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9a810e, atime: 0x6a9a810d, ctime: 0x6a9a810e, blocks: 0xb 00010000:00010000:1.0:1788510482.413947:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1788510482.413952:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510482.413962:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed66358 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735ac expref: 8 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510482.413981:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed66358 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735ac expref: 8 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510482.413994:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033200, rc 0) 00000100:00100000:1.0:1788510482.414058:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2343:x1875388852702592:12345-192.168.201.4@tcp:101:cat.0 Request processed in 211us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510482.414066:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 70 00000100:00080000:2.0:1788510482.414118:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788510482.417406:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510482.417474:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852702720 00000100:00100000:1.0:1788510482.417485:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852702720 00002000:00100000:1.0:1788510482.417558:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff929aaeca0000 x1875388852702720/t0(0) o3->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:53/0 lens 488/0 e 0 to 0 dl 1788510493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788510482.417569:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aaeca0000 with x1875388852702720 ext(0->4095) 00002000:00010000:1.0:1788510482.417575:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929aaeca0000 00000100:00100000:1.0:1788510482.417614:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:1.0:1788510482.417636:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2342:x1875388852702720:12345-192.168.201.4@tcp:3:cat.0 00000100:00100000:1.0:1788510482.417928:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+8:2342:x1875388852702720:12345-192.168.201.4@tcp:3:cat.0 Request processed in 303us (537us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788510482.417937:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 7 00002000:00100000:1.0:1788510482.417944:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff929aaeca0000 x1875388852702720/t0(0) o3->cef40ebf-ceed-4c16-b27b-e8bced3a8d2f@192.168.201.4@tcp:53/0 lens 488/4536 e 0 to 0 dl 1788510493 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788510482.417952:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff929aaeca0000 with x1875388852702720 ext(0->4095) 00002000:00010000:1.0:1788510482.417956:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff929aaeca0000 00010000:00010000:2.0:1788510482.692560:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510483.717033:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510484.166749:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861074176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788510484.166835:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510484.169442:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861074176 00000100:00100000:1.0:1788510484.169472:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861074176 00000100:00100000:1.0:1788510484.169575:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788510484.169593:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861074176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788510484.169652:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788510484.170574:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510484.171922:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861074176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2327us (5079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510484.171935:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788510484.171991:0:3288:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788510484.171997:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788510484.172016:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff929abae6a300, transno 4294967310 00000100:00100000:1.0:1788510484.172045:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861074176:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788510484.226341:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1788510484.226357:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1788510484.229121:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000004:00080000:3.0:1788510484.229151:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:2.0:1788510484.229429:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861074304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788510484.229508:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510484.229592:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861074304 00000100:00100000:2.0:1788510484.229600:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861074304 00000100:00100000:2.0:1788510484.229651:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788510484.229660:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861074304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788510484.229881:0:8183:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788510484.229886:0:8183:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788510478 -> 1788510478 00002000:00010000:2.0:1788510484.229888:0:8183:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1788510477 -> 1788510477 00002000:00010000:2.0:1788510484.229890:0:8183:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788510478 -> 1788510478 00002000:00010000:2.0:1788510484.230118:0:8183:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788510484.230169:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1875388861074304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 510us (661us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788510484.230178:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788510484.230200:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788510484.230347:0:3289:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1788510484.230353:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff929abae68000, transno 4294967321 00000004:00080000:0.0:1788510484.230359:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:0.0:1788510484.230382:0:3289:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff929aaeb20000 x1875388861074304/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788510500 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788510484.230393:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929aaeb20000/2, rc 0, transno 4294967324 00000100:00100000:0.0:1788510484.230398:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861074304:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1788510484.230813:0:5843:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff929a85cf83c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788510484.230818:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929aac60e900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff929a857c3840 00000020:00080000:3.0:1788510484.230822:0:5843:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff929aac60e200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff929aafe6a800 00000020:00080000:0.0:1788510484.230856:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:0.0:1788510484.230966:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788510484.231054:0:5843:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1788510484.740522:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510485.604347:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510485.604399:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510485.604453:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510485.604498:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510485.604526:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510485.604557:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852703232 00000100:00100000:0.0:1788510485.604568:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852703232 00000100:00100000:0.0:1788510485.604628:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852703104 00000100:00100000:0.0:1788510485.604631:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852703104 00000100:00100000:0.0:1788510485.604656:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 103 00000100:00100000:0.0:1788510485.604665:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2342:x1875388852703232:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510485.604714:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852702848 00000100:00100000:3.0:1788510485.604720:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852702848 00000100:00100000:0.0:1788510485.604747:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2342:x1875388852703232:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 81us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510485.604759:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 103 00000100:00100000:3.0:1788510485.604762:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 302 00000100:00100000:3.0:1788510485.604772:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2342:x1875388852702848:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510485.604781:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 104 00000100:00100000:0.0:1788510485.604792:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852703104:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510485.604823:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2342:x1875388852702848:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 52us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510485.604829:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852703104:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 35us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510485.604837:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 302 00000100:00100000:0.0:1788510485.604841:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 104 00000100:00100000:0.0:1788510485.604865:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852702976 00000100:00100000:0.0:1788510485.604869:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852702976 00000100:00100000:0.0:1788510485.604893:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852703360 00000100:00100000:0.0:1788510485.604895:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852703360 00000100:00100000:0.0:1788510485.604910:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 173 00000100:00100000:0.0:1788510485.604915:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:2342:x1875388852702976:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510485.604945:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:2342:x1875388852702976:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 30us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510485.604951:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 173 00000100:00100000:0.0:1788510485.604960:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 174 00000100:00100000:0.0:1788510485.604973:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2342:x1875388852703360:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510485.605016:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2342:x1875388852703360:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 43us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510485.605198:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 174 00000100:00080000:2.0:1788510485.605731:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788510485.605737:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788510485.605740:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788510485.764905:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510486.223530:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeb23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861074432:0@lo:400:kworker.0 00000100:00100000:2.0:1788510486.223612:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510486.223664:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861074944:0@lo:400:kworker.0 00000100:00100000:2.0:1788510486.223691:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510486.223718:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788510486.223724:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeb23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861074560:0@lo:400:kworker.0 00000100:00100000:2.0:1788510486.223746:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510486.223765:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861075072:0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.223868:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861074816:0@lo:400:kworker.0 00000100:00100000:3.0:1788510486.224460:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861074432 00000100:00100000:3.0:1788510486.224470:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861074432 00000100:00100000:3.0:1788510486.224521:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788510486.224532:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861074432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.224805:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510486.224836:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788510486.224844:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861074688:0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.224869:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510486.224910:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861074816 00000100:00100000:0.0:1788510486.224914:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861074816 00000100:00100000:0.0:1788510486.224957:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788510486.224965:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861074816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.225004:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861074816:12345-0@lo:400:kworker.0 Request processed in 40us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510486.225012:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788510486.225037:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861074944 00000100:00100000:0.0:1788510486.225040:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861074944 00000100:00100000:0.0:1788510486.225064:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861074560 00000100:00100000:0.0:1788510486.225067:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861074560 00000100:00100000:0.0:1788510486.225076:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861074688 00000100:00100000:0.0:1788510486.225078:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861074688 00000100:00100000:0.0:1788510486.225089:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788510486.225095:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861074944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.225127:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861074944:12345-0@lo:400:kworker.0 Request processed in 32us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510486.225134:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788510486.225154:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788510486.225161:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861074560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.225191:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861074560:12345-0@lo:400:kworker.0 Request processed in 31us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510486.225196:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788510486.225206:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788510486.225211:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861074688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.225266:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861074688:12345-0@lo:400:kworker.0 Request processed in 54us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510486.225272:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1788510486.225287:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788510486.225291:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510486.225337:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861074688:0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.225349:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861074816:0@lo:400:kworker.0 00000100:00100000:2.0:1788510486.225983:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510486.226021:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861074944:0@lo:400:kworker.0 00000100:00100000:2.0:1788510486.226048:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeb23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861074560:0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.226115:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861075072 00000100:00100000:0.0:1788510486.226120:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861075072 00000100:00100000:0.0:1788510486.226172:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788510486.226180:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861075072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.226425:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1875388861075072:12345-0@lo:400:kworker.0 Request processed in 245us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510486.226433:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788510486.226514:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788510486.226588:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861074432:12345-0@lo:400:kworker.0 Request processed in 2057us (2975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510486.226597:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788510486.226905:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861075072:0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.226916:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeb23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861074432:0@lo:400:kworker.0 00000100:00100000:0.0:1788510486.724464:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861075200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510486.724574:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510486.724709:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861075200 00000100:00100000:1.0:1788510486.724720:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861075200 00000100:00100000:1.0:1788510486.724786:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788510486.724799:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875388861075200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788510486.724842:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510486.725005:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875388861075200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 209us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510486.725013:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788510486.725103:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861075200:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788510486.794263:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510487.357462:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510487.357590:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852703488 00000100:00100000:2.0:1788510487.357605:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852703488 00000100:00100000:2.0:1788510487.357712:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 238 00000100:00100000:2.0:1788510487.357723:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11289:x1875388852703488:12345-192.168.201.4@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1788510487.358350:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510487.358499:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11289:x1875388852703488:12345-192.168.201.4@tcp:60:lhsmtool_posix.0 Request processed in 777us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510487.358510:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 238 00000100:00100000:3.0:1788510487.368036:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510487.368177:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852703744 00000100:00100000:1.0:1788510487.368188:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852703744 00000100:00100000:1.0:1788510487.368307:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 65 00000100:00100000:1.0:1788510487.368318:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:11289:x1875388852703744:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788510487.368705:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:11289:x1875388852703744:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 387us (684us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788510487.368714:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 65 00000100:00100000:0.0:1788510487.726343:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510487.726440:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852703872 00000100:00100000:1.0:1788510487.726450:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852703872 00000100:00100000:1.0:1788510487.726528:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 239 00000100:00100000:1.0:1788510487.726539:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abac0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+5:12097:x1875388852703872:12345-192.168.201.4@tcp:101:lsof.0 00010000:00010000:1.0:1788510487.726565:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510487.726588:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6635f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc735b3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510487.726669:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66366 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510487.726688:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510487.726701:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510487.726732:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788510487.726735:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510487.726758:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510487.726780:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033e00/0x3e734462ed6635f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735b3 expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510487.726799:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66366 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735b3 expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510487.726808:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eab100) 00010000:00010000:1.0:1788510487.726811:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788510487.726814:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032400, rc 0) 00000100:00100000:1.0:1788510487.726886:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abac0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+6:12097:x1875388852703872:12345-192.168.201.4@tcp:101:lsof.0 Request processed in 341us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510487.726894:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 239 00000100:00080000:0.0:1788510487.726954:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788510487.814380:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788510488.196602:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788510488.196614:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788510488.196902:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788510488.196910:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788510488.836533:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510489.284845:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788510489.284869:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaeca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861075328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788510489.284950:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510489.286983:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861075328 00000100:00100000:2.0:1788510489.286997:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861075328 00000100:00100000:2.0:1788510489.287088:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788510489.287099:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861075328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510489.287141:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510489.287269:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861075328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (2318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510489.287277:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788510489.287346:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaeca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861075328:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788510489.287761:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1788510489.362000:0:5843:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1788510489.362032:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788510489.362770:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788510489.362789:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1788510489.371084:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:0.0:1788510489.886509:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788510490.377673:0:12852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:28:08 (1788510488) 00000100:00100000:3.0:1788510490.737418:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510490.737464:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510490.737498:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510490.737525:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510490.737561:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852704256 00000100:00100000:3.0:1788510490.737571:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852704256 00000100:00100000:2.0:1788510490.737596:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852704000 00000100:00100000:2.0:1788510490.737604:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852704000 00000100:00100000:2.0:1788510490.737651:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 304 00000100:00100000:3.0:1788510490.737656:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852704384 00000100:00100000:3.0:1788510490.737661:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852704384 00000100:00100000:2.0:1788510490.737663:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852704000:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510490.737694:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 107 00000100:00100000:3.0:1788510490.737704:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852704256:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510490.737763:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2341:x1875388852704000:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 102us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510490.737772:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2342:x1875388852704256:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 69us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510490.737775:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 304 00000100:00100000:3.0:1788510490.737794:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 107 00000100:00100000:2.0:1788510490.737816:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 108 00000100:00100000:2.0:1788510490.737825:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2343:x1875388852704384:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510490.737853:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2343:x1875388852704384:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 29us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510490.737859:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 108 00000100:00100000:1.0:1788510490.737968:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852704128 00000100:00100000:1.0:1788510490.737974:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852704128 00000100:00100000:1.0:1788510490.738022:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 178 00000100:00100000:1.0:1788510490.738034:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:2340:x1875388852704128:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510490.738090:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:2340:x1875388852704128:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 60us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510490.738097:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 178 00000100:00080000:3.0:1788510490.738257:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788510490.738262:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788510490.738264:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788510490.749555:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510490.749668:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852704512 00000100:00100000:1.0:1788510490.749680:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852704512 00000100:00100000:1.0:1788510490.749773:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 179 00000100:00100000:1.0:1788510490.749785:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2342:x1875388852704512:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510490.749884:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2342:x1875388852704512:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 102us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510490.749892:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 179 00000100:00080000:3.0:1788510490.750483:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788510490.948707:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510491.332740:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861075712:0@lo:400:kworker.0 00000100:00100000:2.0:1788510491.332814:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510491.332877:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788510491.332884:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861075840:0@lo:400:kworker.0 00000100:00100000:2.0:1788510491.332910:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510491.332954:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861075712 00000100:00100000:2.0:1788510491.332962:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861075712 00000100:00100000:2.0:1788510491.333025:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788510491.333035:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861075712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510491.333090:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861075712:12345-0@lo:400:kworker.0 Request processed in 57us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510491.333098:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1788510491.333120:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510491.333174:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861075712:0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.333265:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861075456:0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.333300:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510491.333328:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861075968:0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.333351:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510491.333370:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788510491.333375:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861075584:0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.333396:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510491.333411:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861076096:0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.333431:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510491.333463:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861075968 00000100:00100000:1.0:1788510491.333467:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861075968 00000100:00100000:1.0:1788510491.333506:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861075584 00000100:00100000:1.0:1788510491.333510:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861075584 00000100:00100000:1.0:1788510491.333525:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788510491.333532:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861075968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.333568:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861075968:12345-0@lo:400:kworker.0 Request processed in 36us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510491.333574:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788510491.333588:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788510491.333593:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abae68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861075584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.333618:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abae68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861075584:12345-0@lo:400:kworker.0 Request processed in 25us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510491.333623:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788510491.333646:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861075584:0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.333657:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861075968:0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.334301:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861075840 00000100:00100000:1.0:1788510491.334307:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861075840 00000100:00100000:1.0:1788510491.334342:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861076096 00000100:00100000:1.0:1788510491.334346:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861076096 00000100:00100000:1.0:1788510491.334369:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788510491.334377:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861075840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.334423:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861075840:12345-0@lo:400:kworker.0 Request processed in 47us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510491.334429:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788510491.334441:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788510491.334446:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861076096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.334474:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861076096:12345-0@lo:400:kworker.0 Request processed in 28us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510491.334486:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788510491.334511:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788510491.334516:0:3290:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff929aaeb20000, transno 4294967324 00000100:00100000:1.0:1788510491.334525:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861076096:0@lo:400:kworker.0 00000100:00100000:2.0:1788510491.334651:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861075456 00000100:00100000:2.0:1788510491.334656:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861075456 00000100:00100000:2.0:1788510491.334698:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788510491.334705:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861075456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510491.334742:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861075456:12345-0@lo:400:kworker.0 Request processed in 37us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510491.334748:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:2.0:1788510491.335086:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788510491.335091:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788510491.335093:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510491.335113:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861075456:0@lo:400:kworker.0 00000100:00100000:2.0:1788510491.335138:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861075840:0@lo:400:kworker.0 00000100:00100000:1.0:1788510491.846577:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861076224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788510491.846650:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510491.846731:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861076224 00000100:00100000:1.0:1788510491.846740:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861076224 00000100:00100000:1.0:1788510491.846791:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788510491.846801:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861076224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788510491.846837:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788510491.846890:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861076224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510491.846898:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788510491.846958:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861076224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788510491.972391:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510492.998375:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510494.027348:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510494.404727:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788510494.404753:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861076352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788510494.404837:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510494.404919:0:10289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861076352 00000100:00100000:3.0:1788510494.404927:0:10289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861076352 00000100:00100000:3.0:1788510494.404984:0:10289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788510494.404995:0:10289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861076352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788510494.405040:0:10289:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510494.405087:0:10289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861076352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510494.405094:0:10289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788510494.405155:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861076352:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788510494.406064:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510494.742590:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510494.742673:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852704768 00000100:00100000:0.0:1788510494.742688:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852704768 00000100:00100000:0.0:1788510494.742768:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 66 00000100:00100000:0.0:1788510494.742780:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+18:12318:x1875388852704768:12345-192.168.201.4@tcp:35:umount.0 00000100:00100000:0.0:1788510494.743193:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:12318:x1875388852704768:12345-192.168.201.4@tcp:35:umount.0 Request processed in 415us (611us total) trans 4294967521 rc 0/0 00000100:00080000:2.0:1788510494.743287:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510494.743802:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 66 00000100:00100000:2.0:1788510494.745470:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510494.747206:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852705024 00000100:00100000:0.0:1788510494.747219:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852705024 00000100:00100000:0.0:1788510494.747301:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 67 00000100:00100000:0.0:1788510494.747311:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+19:12318:x1875388852705024:12345-192.168.201.4@tcp:35:umount.0 00000100:00100000:0.0:1788510494.747653:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:12318:x1875388852705024:12345-192.168.201.4@tcp:35:umount.0 Request processed in 343us (2190us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788510494.747661:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 67 00000100:00100000:3.0:1788510494.751093:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510494.751454:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852705280 00000100:00100000:0.0:1788510494.751464:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852705280 00000100:00100000:0.0:1788510494.751574:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 68 00000100:00100000:0.0:1788510494.751586:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aa57f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+20:12318:x1875388852705280:12345-192.168.201.4@tcp:35:umount.0 00000100:00100000:0.0:1788510494.751856:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aa57f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:12318:x1875388852705280:12345-192.168.201.4@tcp:35:umount.0 Request processed in 272us (768us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788510494.751863:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 68 00000100:00100000:2.0:1788510494.758207:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510494.758342:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852705536 00000100:00100000:1.0:1788510494.758352:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852705536 00000100:00100000:1.0:1788510494.758450:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 69 00000100:00100000:1.0:1788510494.758460:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:12318:x1875388852705536:12345-192.168.201.4@tcp:35:umount.0 00000100:00100000:1.0:1788510494.758839:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:12318:x1875388852705536:12345-192.168.201.4@tcp:35:umount.0 Request processed in 380us (641us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788510494.758846:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 69 00000100:00100000:2.0:1788510494.762321:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510494.762359:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510494.762395:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510494.762551:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852705664 00000100:00100000:3.0:1788510494.762561:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852705664 00000100:00100000:3.0:1788510494.762602:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852705920 00000100:00100000:3.0:1788510494.762605:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852705920 00000100:00100000:3.0:1788510494.762617:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852705792 00000100:00100000:3.0:1788510494.762620:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852705792 00000100:00100000:3.0:1788510494.762635:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:3.0:1788510494.762659:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+15:2343:x1875388852705664:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510494.762674:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510494.762692:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80030400/0x3e734462ed653de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7313e expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.762723:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510494.762779:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+14:2343:x1875388852705664:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 123us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510494.762786:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:3.0:1788510494.763198:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:1.0:1788510494.763205:0:5807:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788510494.763206:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+13:2343:x1875388852705920:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510494.763214:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788510494.763214:0:5807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788510494.763263:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929aaec76e00/0x3e734462ed655c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73209 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.763273:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510494.763309:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:2343:x1875388852705920:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 103us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510494.763315:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:3.0:1788510494.763328:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:3.0:1788510494.763334:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:2343:x1875388852705792:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510494.763343:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510494.763352:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83033a00/0x3e734462ed65344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73106 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.763359:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510494.763383:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2343:x1875388852705792:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 49us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510494.763389:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:2.0:1788510494.765733:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510494.765891:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852706304 00000100:00100000:3.0:1788510494.765900:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852706304 00000100:00100000:3.0:1788510494.765956:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 72 00000100:00100000:3.0:1788510494.765966:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+7:2339:x1875388852706304:12345-192.168.201.4@tcp:9:umount.0 00000020:00000080:3.0:1788510494.765993:0:6669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed6591e 00000020:00010000:3.0:1788510494.766001:0:6669:0:(genops.c:1921:obd_stale_export_put()) Put export ffff929abb3a5800: total 0 00000100:00080000:3.0:1788510494.766005:0:6669:0:(import.c:65:import_set_state_nolock()) ffff929abb3a4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788510494.766051:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788510494.766337:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2339:x1875388852706304:12345-192.168.201.4@tcp:9:umount.0 Request processed in 372us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510494.766345:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 72 00000020:00010000:1.0:1788510494.766391:0:5809:0:(genops.c:1907:obd_stale_export_get()) Get export ffff929abb3a5800: total 0 00010000:00010000:1.0:1788510494.766426:0:5809:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff929abb3a5800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788510494.766466:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a20428a8/0x3e734462ed66358 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735ac expref: 4 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510494.766485:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed65cba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733de expref: 3 pid: 8183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510494.766495:0:5809:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff929abb3a5800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788510494.766500:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510494.766502:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510494.766503:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788510494.766535:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788510494.770872:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510494.770950:0:8183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852706432 00000100:00100000:2.0:1788510494.770959:0:8183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852706432 00000100:00080000:0.0:1788510494.771006:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510494.771033:0:8183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 73 00000100:00100000:2.0:1788510494.771041:0:8183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+5:2339:x1875388852706432:12345-192.168.201.4@tcp:9:umount.0 00000020:00000080:2.0:1788510494.771065:0:8183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed656b6 00000100:00080000:2.0:1788510494.771072:0:8183:0:(import.c:65:import_set_state_nolock()) ffff929981eac800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788510494.771124:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788510494.771128:0:8183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788510494.771407:0:8183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+2:2339:x1875388852706432:12345-192.168.201.4@tcp:9:umount.0 Request processed in 365us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510494.771415:0:8183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 73 00000100:00100000:2.0:1788510494.779926:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510494.780007:0:9544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852707456 00000100:00100000:1.0:1788510494.780016:0:9544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852707456 00000100:00100000:1.0:1788510494.780064:0:9544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 240 00000100:00100000:1.0:1788510494.780072:0:9544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+22:2339:x1875388852707456:12345-192.168.201.4@tcp:39:umount.0 00000020:00000080:1.0:1788510494.780110:0:9544:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65352 00000020:00010000:1.0:1788510494.780122:0:9544:0:(genops.c:1921:obd_stale_export_put()) Put export ffff929ab7c9f000: total 0 00000100:00080000:1.0:1788510494.780131:0:9544:0:(import.c:65:import_set_state_nolock()) ffff929ab7c9d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788510494.780290:0:9544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1788510494.780623:0:9544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cef40ebf-ceed-4c16-b27b-e8bced3a8d2f+21:2339:x1875388852707456:12345-192.168.201.4@tcp:39:umount.0 Request processed in 549us (702us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788510494.780631:0:9544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 240 00000020:00010000:3.0:1788510494.781004:0:5809:0:(genops.c:1907:obd_stale_export_get()) Get export ffff929ab7c9f000: total 0 00010000:00010000:3.0:1788510494.781009:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510494.781048:0:5809:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff929ab7c9f000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788510494.781078:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:3.0:1788510494.781082:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788510494.781090:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68800/0x3e734462ed65ca5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733d7 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.781121:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:3.0:1788510494.781124:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510494.781128:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033400/0x3e734462ed66319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73597 expref: 19 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.781142:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:3.0:1788510494.781160:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788510494.781164:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae200/0x3e734462ed66343 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735a5 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.781179:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:3.0:1788510494.781181:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510494.781184:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed65c7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733c9 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.781195:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:3.0:1788510494.781198:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788510494.781201:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66017 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc734d3 expref: 16 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.781212:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:3.0:1788510494.781214:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788510494.781218:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafc00/0x3e734462ed65979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73305 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.781598:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff929a8b8f5500) 00010000:00010000:3.0:1788510494.781601:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788510494.781607:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed6561c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73217 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.781627:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff929aac578200) 00010000:00010000:3.0:1788510494.781629:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788510494.781632:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77000/0x3e734462ed65d38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73401 expref: 13 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.783664:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff929a82b92e00) 00010000:00010000:3.0:1788510494.783668:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788510494.783676:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69400/0x3e734462ed65b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73391 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.783691:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff929a83eab300) 00010000:00010000:3.0:1788510494.783693:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788510494.783697:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a81532200/0x3e734462ed6568c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73233 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.783711:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff929aac578700) 00010000:00010000:3.0:1788510494.783724:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788510494.783729:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69a00/0x3e734462ed66239 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7355f expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.783744:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eab100) 00010000:00010000:3.0:1788510494.783746:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788510494.783750:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68e00/0x3e734462ed65d1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc733fa expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.783762:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a82b92200) 00010000:00010000:3.0:1788510494.783764:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510494.783768:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032e00/0x3e734462ed65638 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7321e expref: 8 pid: 9544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510494.783782:0:5809:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff929ab7c9f000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788510494.783821:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510494.783829:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510494.783831:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510495.045151:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510495.850605:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510495.850707:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510495.851181:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852707712 00000100:00100000:3.0:1788510495.851191:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852707712 00000100:00100000:3.0:1788510495.851298:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 183 00000100:00100000:3.0:1788510495.851308:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2342:x1875388852707712:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510495.851383:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2342:x1875388852707712:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 77us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510495.851390:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 183 00000100:00080000:0.0:1788510495.851604:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510495.853651:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852707584 00000100:00100000:2.0:1788510495.853668:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852707584 00000100:00100000:2.0:1788510495.853793:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 306 00000100:00100000:2.0:1788510495.853806:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2342:x1875388852707584:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510495.853888:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2342:x1875388852707584:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 85us (3296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510495.853895:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 306 00010000:00010000:3.0:1788510496.068681:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510496.189011:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510496.189059:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510496.189116:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510496.189206:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852707840 00000100:00100000:2.0:1788510496.189217:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852707840 00000100:00100000:2.0:1788510496.189301:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852708096 00000100:00100000:2.0:1788510496.189305:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852708096 00000100:00100000:2.0:1788510496.189319:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852707968 00000100:00100000:2.0:1788510496.189322:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852707968 00000100:00100000:2.0:1788510496.189338:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:2.0:1788510496.189347:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+12:2342:x1875388852707840:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510496.189364:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510496.189385:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81532800/0x3e734462ed65424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73153 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510496.189404:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510496.189458:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+11:2342:x1875388852707840:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 113us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510496.189464:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:2.0:1788510496.189491:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 23 00000100:00100000:2.0:1788510496.189495:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+10:2340:x1875388852708096:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510496.189501:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510496.189508:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80031a00/0x3e734462ed655c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73202 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510496.189514:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510496.189526:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+9:2340:x1875388852708096:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 32us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510496.189531:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 23 00000100:00100000:2.0:1788510496.189568:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 24 00000100:00100000:2.0:1788510496.189572:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaeca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+8:2342:x1875388852707968:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788510496.189576:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510496.189582:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81533200/0x3e734462ed6542b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7317d expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510496.189588:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788510496.189596:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaeca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dadbea-4c8c-47ce-beef-15ce80e646ee+7:2342:x1875388852707968:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 24us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510496.189600:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 24 00000100:00100000:0.0:1788510496.195017:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510496.195533:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852708352 00000100:00100000:2.0:1788510496.195544:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852708352 00000100:00100000:2.0:1788510496.195605:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 241 00000100:00100000:2.0:1788510496.195615:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+6:2339:x1875388852708352:12345-192.168.201.4@tcp:39:umount.0 00000020:00000080:2.0:1788510496.195663:0:5821:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65439 00000020:00010000:2.0:1788510496.195671:0:5821:0:(genops.c:1921:obd_stale_export_put()) Put export ffff929abaac8800: total 0 00000100:00080000:2.0:1788510496.195675:0:5821:0:(import.c:65:import_set_state_nolock()) ffff929abaacb800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788510496.195715:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788510496.195923:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cf9f1e0-2527-425a-acbd-f88466347be1+5:2339:x1875388852708352:12345-192.168.201.4@tcp:39:umount.0 Request processed in 308us (914us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788510496.195930:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 241 00000020:00010000:0.0:1788510496.196477:0:5810:0:(genops.c:1907:obd_stale_export_get()) Get export ffff929abaac8800: total 0 00010000:00010000:0.0:1788510496.196528:0:5810:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff929abaac8800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788510496.196559:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eab100) 00010000:00010000:0.0:1788510496.196563:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788510496.196571:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66366 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735b3 expref: 4 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510496.196590:0:5810:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff929abaac8800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788510496.196600:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510496.196602:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510496.196604:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510496.230368:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510496.230461:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852708608 00000100:00100000:1.0:1788510496.230471:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852708608 00000100:00100000:1.0:1788510496.230526:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 307 00000100:00100000:1.0:1788510496.230537:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+7:2339:x1875388852708608:12345-192.168.201.4@tcp:251:umount.0 00000020:00000080:1.0:1788510496.230603:0:5815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed6532f 00000020:00010000:1.0:1788510496.230612:0:5815:0:(genops.c:1921:obd_stale_export_put()) Put export ffff929ab7c9d800: total 0 00000100:00080000:1.0:1788510496.230617:0:5815:0:(import.c:65:import_set_state_nolock()) ffff929ab7c9a800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788510496.230716:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dadbea-4c8c-47ce-beef-15ce80e646ee+3:2339:x1875388852708608:12345-192.168.201.4@tcp:251:umount.0 Request processed in 174us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510496.230724:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 307 00000020:00010000:0.0:1788510496.230745:0:5809:0:(genops.c:1907:obd_stale_export_get()) Get export ffff929ab7c9d800: total 0 00010000:00010000:0.0:1788510496.230752:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510496.230808:0:5809:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff929ab7c9d800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788510496.230852:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81532e00/0x3e734462ed653e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73145 expref: 2 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510496.230870:0:5809:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff929ab7c9d800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788510496.230879:0:5809:0:(genops.c:885:class_export_put()) final put ffff929ab7c9d800/58dadbea-4c8c-47ce-beef-15ce80e646ee 00010000:00010000:0.0:1788510496.230898:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510496.230901:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510496.230902:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788510496.231094:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab7c9d800/58dadbea-4c8c-47ce-beef-15ce80e646ee for MGS 00000020:00000080:1.0:1788510496.231138:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929ab7c9a800 for MGS 00000100:00100000:1.0:1788510496.452857:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861076480:0@lo:400:kworker.0 00000100:00100000:1.0:1788510496.452931:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510496.453008:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861076480 00000100:00100000:3.0:1788510496.453017:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861076480 00000100:00100000:3.0:1788510496.453078:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788510496.453090:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861076480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.457596:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a8578f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861076608:0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.457678:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510496.457723:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861077120:0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.457749:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510496.457771:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788510496.457776:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861076992:0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.457795:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510496.457820:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861076864:0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.457842:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510496.457858:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788510496.457862:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929ab7d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861076736:0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.457880:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510496.457910:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861076608 00000100:00100000:0.0:1788510496.457917:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861076608 00000100:00100000:0.0:1788510496.457963:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861076992 00000100:00100000:0.0:1788510496.457965:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861076992 00000100:00100000:0.0:1788510496.457982:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861076736 00000100:00100000:0.0:1788510496.457989:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861076736 00000100:00100000:0.0:1788510496.458006:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788510496.459670:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861076608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.460418:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861076608:12345-0@lo:400:kworker.0 Request processed in 2400us (2737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510496.460430:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788510496.460463:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788510496.460475:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861076992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.460503:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875388861076992:12345-0@lo:400:kworker.0 Request processed in 33us (2707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510496.460509:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788510496.460518:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788510496.460523:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861076736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.460552:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875388861076736:12345-0@lo:400:kworker.0 Request processed in 29us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510496.460558:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788510496.460581:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861077120 00000100:00100000:0.0:1788510496.460588:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861077120 00000100:00100000:0.0:1788510496.460624:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861076864 00000100:00100000:0.0:1788510496.460627:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861076864 00000100:00100000:0.0:1788510496.460645:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788510496.460651:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861077120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.460678:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861077120:12345-0@lo:400:kworker.0 Request processed in 28us (2929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510496.460684:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788510496.460693:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788510496.460698:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861076864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.460844:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861076864:12345-0@lo:400:kworker.0 Request processed in 146us (3001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510496.460850:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788510496.460899:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3291:1875388861076992:0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.460911:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861076608:0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.460920:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861077120:0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.460953:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929ab7d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3289:1875388861076736:0@lo:400:kworker.0 00000100:00100000:0.0:1788510496.460962:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861076864:0@lo:400:kworker.0 00000100:00080000:0.0:1788510496.460980:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788510496.460984:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788510496.460987:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788510496.461273:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861076480:12345-0@lo:400:kworker.0 Request processed in 8182us (8338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510496.461284:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788510496.463981:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a8578dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861076480:0@lo:400:kworker.0 00000100:00100000:1.0:1788510496.966054:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788510496.966089:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861077248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788510496.966165:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510496.966816:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861077248 00000100:00100000:3.0:1788510496.966826:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861077248 00000100:00100000:3.0:1788510496.966897:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788510496.966908:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861077248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788510496.966957:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510496.967023:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861077248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510496.967031:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788510496.967463:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861077248:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788510497.020685:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000020:00000080:2.0:1788510497.020693:0:6692:0:(genops.c:885:class_export_put()) final put ffff929981eae000/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000020:00000080:2.0:1788510497.020895:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929981eae000/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f for lustre-OST0000 00000020:00000080:2.0:1788510497.020939:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929981eac800 for lustre-OST0000 00010000:00010000:0.0:1788510497.092521:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788510498.029599:0:13053:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788510498.054396:0:13053:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788510498.054446:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.054463:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.054471:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.054479:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.054511:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788510498.054517:0:13053:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788510498.054549:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788510498.054553:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788510498.054558:0:13053:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1788510498.054738:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510498.054746:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.054754:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd600 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:0.0:1788510498.054758:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.054776:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788510498.054785:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510498.054791:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788510498.054799:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788510498.054802:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788510498.054835:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.054842:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788510498.054872:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.054880:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a813fd600/0x3e734462ed653b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed653bb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.054893:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510498.054895:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510498.054897:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510498.055014:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788510498.055032:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861077376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788510498.055109:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788510498.055318:0:13053:0:(import.c:65:import_set_state_nolock()) ffff929aade30800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788510498.055527:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875388861077504:0@lo:39:umount.0 00000100:00100000:0.0:1788510498.055755:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510498.055884:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861077504 00000100:00100000:1.0:1788510498.055892:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861077504 00000100:00100000:1.0:1788510498.055962:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788510498.055971:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875388861077504:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788510498.055993:0:5823:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed6514c 00000100:00080000:1.0:1788510498.056000:0:5823:0:(import.c:65:import_set_state_nolock()) ffff929ab4e95800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788510498.056065:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3287:x1875388861077504:12345-0@lo:39:umount.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510498.056073:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788510498.056083:0:5823:0:(genops.c:885:class_export_put()) final put ffff929ab4e93800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788510498.056116:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788510498.056125:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab4e93800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788510498.056166:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929ab4e95800 for lustre-MDT0000 00000100:00080000:0.0:1788510498.056193:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929aade30800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788510498.056202:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875388861077504:0@lo:39:umount.0 00000100:00080000:0.0:1788510498.056251:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788510498.056253:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788510498.056256:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788510498.057469:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.057487:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.057496:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.057502:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.057517:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788510498.057528:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510498.057533:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.057540:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033800 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:0.0:1788510498.057544:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.057552:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788510498.057558:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510498.057564:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788510498.057568:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788510498.057883:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.057899:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788510498.057944:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861077632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510498.057987:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788510498.058050:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058060:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a83033800/0x3e734462ed653c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed653c9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058073:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510498.058075:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510498.058077:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510498.058092:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058100:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058108:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510498.058115:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861077376 00010000:00010000:0.0:1788510498.058115:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510498.058125:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861077376 00010000:00010000:0.0:1788510498.058130:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788510498.058139:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510498.058143:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058150:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a81533a00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:0.0:1788510498.058154:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058167:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510498.058175:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861077632 10000000:00010000:0.0:1788510498.058175:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510498.058181:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861077632 10000000:01000000:0.0:1788510498.058184:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788510498.058188:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788510498.058190:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788510498.058207:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510498.058210:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788510498.058218:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788510498.058239:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+20:3288:x1875388861077376:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510498.058290:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788510498.058297:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861077760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510498.058319:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510498.058341:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861077760 00000100:00100000:1.0:1788510498.058344:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861077760 00000100:00100000:1.0:1788510498.058363:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788510498.058368:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:040cea51-0882-49ef-ac64-3cc6497ba05a+21:3290:x1875388861077632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510498.058377:0:12964:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510498.058394:0:12964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fce00/0x3e734462ed653c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed653c2 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.058406:0:12964:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510498.058433:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:040cea51-0882-49ef-ac64-3cc6497ba05a+20:3290:x1875388861077632:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510498.058440:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788510498.058454:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788510498.058459:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:040cea51-0882-49ef-ac64-3cc6497ba05a+19:3290:x1875388861077760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510498.058466:0:12964:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510498.058472:0:12964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fca00/0x3e734462ed652f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed652e9 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.058483:0:12964:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510498.058499:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:040cea51-0882-49ef-ac64-3cc6497ba05a+18:3290:x1875388861077760:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510498.058505:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788510498.058534:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861077760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510498.058554:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861077632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788510498.058862:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058871:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81533a00/0x3e734462ed652e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed652f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058884:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510498.058886:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510498.058888:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510498.058900:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058907:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058914:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058932:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058975:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788510498.058982:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fc200/0x3e734462ed6509d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.058989:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fc200/0x3e734462ed6509d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510498.058990:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510498.058999:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fc200/0x3e734462ed6509d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510498.059006:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83032c00/0x3e734462ed653bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed653b4 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510498.059008:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a813fc200/0x3e734462ed6509d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510498.059031:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788510498.059047:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788510498.059052:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.059059:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eae800 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510498.059063:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.059071:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510498.059083:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510498.059089:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788510498.059091:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788510498.059093:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788510498.059109:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.059115:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510498.059131:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.059138:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a90eae800/0x3e734462ed655eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed655f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.059150:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510498.059153:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a813fc200/0x3e734462ed6509d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.059159:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc200 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510498.059162:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a813fc200/0x3e734462ed6509d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.059169:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a813fc200/0x3e734462ed6509d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510498.059176:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a813fc200/0x3e734462ed6509d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510498.059190:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788510498.059193:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1788510498.059206:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a813fc200/0x3e734462ed6509d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.059212:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510498.059218:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a813fc200/0x3e734462ed6509d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510498.059247:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510498.059249:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510498.059251:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510498.059264:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861077888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510498.059300:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510498.059335:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510498.059341:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861078016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510498.059365:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510498.059395:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861077888 00000100:00100000:1.0:1788510498.059399:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861077888 00000100:00100000:1.0:1788510498.059434:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861078016 00000100:00100000:1.0:1788510498.059437:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861078016 00000100:00100000:3.0:1788510498.059445:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788510498.059481:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788510498.059486:0:13053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a813fc200/0x3e734462ed6509d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed650a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510498.059499:0:13053:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1788510498.059503:0:13053:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788510498.059505:0:13053:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:2.0:1788510498.059526:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:040cea51-0882-49ef-ac64-3cc6497ba05a+18:3288:x1875388861077376:12345-0@lo:103:ldlm_bl.0 Request processed in 1303us (4416us total) trans 0 rc 0/0 00010000:00010000:0.0:1788510498.059541:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788510498.059553:0:13053:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788510498.059557:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788510498.059562:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788510498.059567:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1788510498.059578:0:13053:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff929a84f5d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788510498.059589:0:13053:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92998185c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788510498.059596:0:13053:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff929abaac8800 2cf9f1e0-2527-425a-acbd-f88466347be1 192.168.201.4@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788510498.059602:0:13053:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff929ab7c9f000 cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 192.168.201.4@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:0.0:1788510498.059607:0:13053:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff929a82d299c0) has exports, disconnecting them 00000020:00080000:0.0:1788510498.059612:0:13053:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff929a84f5d800), last request at 1788510496 00000020:00000080:0.0:1788510498.059618:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed652b1 00000100:00080000:0.0:1788510498.059632:0:13053:0:(import.c:65:import_set_state_nolock()) ffff929a84f5b000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788510498.059683:0:13053:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff929a84f5d800): rc 0 00000020:00000080:0.0:1788510498.059686:0:13053:0:(genops.c:885:class_export_put()) final put ffff929a84f5d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788510498.059695:0:13053:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92998185c800), last request at 1788510496 00000020:00000080:0.0:1788510498.059698:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed651e6 00000100:00080000:0.0:1788510498.059703:0:13053:0:(import.c:65:import_set_state_nolock()) ffff92998185a800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788510498.059713:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929a84f5d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788510498.059744:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929a84f5b000 for lustre-MDT0000 00010000:00010000:0.0:1788510498.059751:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788510498.059760:0:13053:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92998185c800): rc 0 00000020:00000080:0.0:1788510498.059762:0:13053:0:(genops.c:885:class_export_put()) final put ffff92998185c800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788510498.059781:0:13053:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc168150fae0 00000020:00000080:0.0:1788510498.059790:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92998185c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788510498.059818:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92998185a800 for lustre-MDT0000 00000100:00080000:0.0:1788510498.059836:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788510498.059839:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788510498.059850:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788510498.059915:0:13053:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788510498.059926:0:13053:0:(import.c:65:import_set_state_nolock()) ffff929a85c6e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788510498.059936:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788510498.059942:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788510498.059949:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788510498.060014:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861078144:0@lo:9:umount.0 00000100:00100000:0.0:1788510498.060054:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788510498.060080:0:13053:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788510498.060088:0:13053:0:(import.c:65:import_set_state_nolock()) ffff929ab7c9f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788510498.060101:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861078272:0@lo:9:umount.0 00000100:00100000:0.0:1788510498.060121:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510498.060143:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861078144 00000100:00100000:0.0:1788510498.060147:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861078144 00000100:00100000:0.0:1788510498.060175:0:12047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861078272 00000100:00100000:0.0:1788510498.060177:0:12047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861078272 00000100:00100000:0.0:1788510498.060192:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788510498.060198:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3287:x1875388861078144:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788510498.060215:0:12047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65233 00000100:00080000:0.0:1788510498.060220:0:12047:0:(import.c:65:import_set_state_nolock()) ffff9299811a4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788510498.060259:0:12047:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788510498.060526:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3287:x1875388861078144:12345-0@lo:9:umount.0 Request processed in 327us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510498.060533:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788510498.060545:0:12047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788510498.060551:0:12047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3287:x1875388861078272:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788510498.060562:0:12047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed6531a 00000100:00080000:0.0:1788510498.060567:0:12047:0:(import.c:65:import_set_state_nolock()) ffff929aaf3a4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788510498.060579:0:12047:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788510498.060657:0:12047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3287:x1875388861078272:12345-0@lo:9:umount.0 Request processed in 105us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510498.060663:0:12047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788510498.060683:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788510498.060686:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788510498.060698:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788510498.060717:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929ab7c9f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788510498.060722:0:3287:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788510498.060723:0:3287:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788510498.060726:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861078272:0@lo:9:umount.0 00000100:00080000:0.0:1788510498.060735:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a85c6e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788510498.060737:0:3287:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788510498.060739:0:3287:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788510498.060741:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861078144:0@lo:9:umount.0 00000020:00080000:0.0:1788510498.060781:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff929a82d299c0) has no exports 00000100:00100000:3.0:1788510498.061215:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+18:3288:x1875388861077888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788510498.061241:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510498.061257:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a90eaea00/0x3e734462ed655f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed655eb expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510498.061267:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861077376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788510498.061270:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788510498.061287:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510498.061323:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+17:3288:x1875388861077888:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510498.061331:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788510498.061352:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788510498.061361:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+16:3288:x1875388861078016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788510498.061370:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510498.061379:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a80030600/0x3e734462ed650a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed6509d expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510498.061393:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510498.061398:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861077888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788510498.061756:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:040cea51-0882-49ef-ac64-3cc6497ba05a+15:3288:x1875388861078016:12345-0@lo:103:ldlm_bl.0 Request processed in 396us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510498.061764:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788510498.061833:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:040cea51-0882-49ef-ac64-3cc6497ba05a:3288:1875388861078016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788510498.065053:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00080000:0.0:1788510498.072827:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff929a82d299c0) has no exports 00000020:00000080:0.0:1788510498.163374:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed650f8 00000020:00000080:0.0:1788510498.163413:0:13053:0:(genops.c:885:class_export_put()) final put ffff929abae4e800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788510498.163589:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00010000:00010000:0.0:1788510498.163963:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788510498.164083:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929abae4e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788510498.164109:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788510498.164135:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788510498.164140:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff929aafdc99c0) has no exports 00000020:00000080:1.0:1788510498.165167:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed650f1 00000020:00000080:1.0:1788510498.166595:0:13053:0:(genops.c:885:class_export_put()) final put ffff929aafddc000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788510498.166732:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929aafddc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788510498.166859:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788510498.166950:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788510498.166980:0:13053:0:(genops.c:885:class_export_put()) final put ffff929aade35000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788510498.166983:0:13053:0:(genops.c:844:class_export_destroy()) destroying export ffff929aade35000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788510498.167001:0:13053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1788510499.204992:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788510499.576461:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:3.0:1788510499.576503:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000001:00080000:3.0:1788510499.576510:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788510499.576515:0:5843:0:(genops.c:885:class_export_put()) final put ffff929ab7c9f000/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000001:00100000:3.0:1788510499.576535:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2cf9f1e0-2527-425a-acbd-f88466347be1 00000001:00080000:3.0:1788510499.576541:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788510499.576543:0:5843:0:(genops.c:885:class_export_put()) final put ffff929abaac8800/2cf9f1e0-2527-425a-acbd-f88466347be1 00000020:00000080:0.0:1788510499.576682:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab7c9f000/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f for lustre-MDT0000 00000020:00000080:0.0:1788510499.576765:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929abaac8800/2cf9f1e0-2527-425a-acbd-f88466347be1 for lustre-MDT0000 00000020:00000080:0.0:1788510499.576788:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929ab7c9d000 for lustre-MDT0000 00000020:00000080:0.0:1788510499.576792:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929abaacb800 for lustre-MDT0000 00000001:00100000:2.0:1788510499.615532:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788510499.615541:0:7621:0:(genops.c:885:class_export_put()) final put ffff929aaf3a3000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788510499.619809:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000020:00000080:2.0:1788510499.619818:0:7621:0:(genops.c:885:class_export_put()) final put ffff929abb3a5800/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f 00000020:00000080:1.0:1788510499.619899:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff929aaf3a3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788510499.620019:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929aaf3a4800 for lustre-OST0001 00000020:00000080:3.0:1788510499.620479:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929abb3a5800/cef40ebf-ceed-4c16-b27b-e8bced3a8d2f for lustre-OST0001 00000020:00000080:2.0:1788510499.620750:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929abb3a4000 for lustre-OST0001 00010000:00010000:0.0:1788510500.228437:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788510500.228543:0:13053:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff929a82d21ae0 - data ffff929ab3e7fa20/ffff929aaf38dc00 00000020:01000000:1.0:1788510500.228712:0:13053:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff929a8545e2a0 - data ffff929a9eb5a000/ffff929aaf745400 00000001:00000004:1.0:1788510500.238589:0:13053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788510500.411880:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788510500.411900:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788510500.411925:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788510500.411927:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788510500.413323:0:6724:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788510500.413329:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1788510500.413340:0:6724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788510500.414702:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788510500.414708:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788510500.414725:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788510500.414728:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788510500.417809:0:8021:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788510500.417817:0:8021:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1788510500.417833:0:8021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788510500.526304:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed650c0 00000020:00000080:0.0:1788510500.526317:0:13053:0:(genops.c:885:class_export_put()) final put ffff929ab51e2800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788510500.527305:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab51e2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788510500.527567:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed650d5 00000020:00000080:0.0:1788510500.527576:0:13053:0:(genops.c:885:class_export_put()) final put ffff929ab4e97800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788510500.527591:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788510500.527597:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788510500.527821:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788510500.527826:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff929a82d2cd40) has no exports 00000004:01000000:0.0:1788510500.527975:0:13053:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788510500.527983:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65313 00000020:00000080:0.0:1788510500.527987:0:13053:0:(genops.c:885:class_export_put()) final put ffff929ab7c9e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788510500.527991:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788510500.528008:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788510500.528015:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788510500.528017:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff929aafdccd40) has no exports 00000020:00000080:0.0:1788510500.528023:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed6530c 00000020:00000080:0.0:1788510500.528027:0:13053:0:(genops.c:885:class_export_put()) final put ffff929ab7c99000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788510500.528445:0:13053:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788510500.528449:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788510500.528454:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788510500.528459:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788510500.528461:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788510500.528488:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788510500.528495:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788510500.528500:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed6522c 00000020:00000080:0.0:1788510500.528504:0:13053:0:(genops.c:885:class_export_put()) final put ffff929a84e0a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788510500.528508:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788510500.528512:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788510500.528515:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788510500.528518:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff929ab4e84d40) has no exports 00000020:00000080:0.0:1788510500.528522:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65225 00000020:00000080:0.0:1788510500.528524:0:13053:0:(genops.c:885:class_export_put()) final put ffff929a85c6d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788510500.528884:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab4e97800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788510500.528893:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab7c9e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788510500.528898:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab7c99000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788510500.528906:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929ab7c9f800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788510500.528912:0:37:0:(genops.c:885:class_export_put()) final put ffff929981eaa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788510500.528914:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929981eaa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788510500.528919:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788510500.528988:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929a84e0a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788510500.528993:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929a85c6d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788510500.529468:0:13053:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788510500.529472:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788510500.529474:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788510500.529478:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788510500.529480:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788510500.529552:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788510500.529568:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788510500.529591:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788510500.529594:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788510500.529597:0:13053:0:(genops.c:885:class_export_put()) final put ffff929ab51e2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788510500.529599:0:13053:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab51e2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788510500.529604:0:13053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788510500.529755:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed650dc 00000020:00000080:0.0:1788510500.529761:0:13053:0:(genops.c:885:class_export_put()) final put ffff929ab4e96000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788510500.530028:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929a85c6e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788510500.530035:0:37:0:(genops.c:885:class_export_put()) final put ffff929a85c69800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788510500.530037:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929a85c69800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788510500.530044:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788510500.530280:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788510500.530286:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788510500.530291:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788510500.530295:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff929a82d28000) has no exports 00000020:00000080:0.0:1788510500.530316:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788510500.530320:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788510500.530325:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed650e3 00000020:00000080:0.0:1788510500.530329:0:13053:0:(genops.c:885:class_export_put()) final put ffff929ab4e94800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788510500.530426:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab4e96000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788510500.530430:0:37:0:(genops.c:885:class_export_put()) final put ffff929ab51e5800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788510500.530432:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab51e5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788510500.530436:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1788510500.530944:0:13053:0:(tgt_mount.c:187:server_put_mount()) put mount ffff929a82ae6000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788510500.530949:0:13053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff929a82ae6000 3 00000020:01000004:0.0:1788510500.530953:0:13053:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff929a82ae6000 from lustre-MDT0000 00000020:00000080:0.0:1788510500.530977:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788510500.530982:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788510500.530985:0:13053:0:(genops.c:885:class_export_put()) final put ffff929ab51e4800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788510500.530988:0:13053:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab51e4800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788510500.531006:0:13053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788510500.531040:0:13053:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788510500.531044:0:13053:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788510500.531047:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788510500.531051:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788510500.531053:0:13053:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788510500.531060:0:13053:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff929a84fd5800 040cea51-0882-49ef-ac64-3cc6497ba05a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788510500.531066:0:13053:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff929a84fbb380) has exports, disconnecting them 00000020:00080000:0.0:1788510500.531070:0:13053:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff929a84fd5800), last request at 1788510257 00000020:00000080:0.0:1788510500.531095:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65081 00000020:00010000:0.0:1788510500.531099:0:13053:0:(genops.c:1921:obd_stale_export_put()) Put export ffff929a84fd5800: total 1 00000100:00080000:0.0:1788510500.531103:0:13053:0:(import.c:65:import_set_state_nolock()) ffff929a84fd6800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788510500.531126:0:13053:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff929a84fd5800): rc 0 00000020:00080000:0.0:1788510500.531131:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff929a84fbb380) has no exports 00000100:00100000:0.0:1788510500.531249:0:5815:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff929a82d5a600:5815] 1 exiting: rc = 0 00000020:00010000:2.0:1788510500.531416:0:5809:0:(genops.c:1907:obd_stale_export_get()) Get export ffff929a84fd5800: total 1 00010000:00010000:2.0:1788510500.531445:0:5809:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff929a84fd5800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788510500.531472:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81532a00/0x3e734462ed653ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed653a6 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510500.531497:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fc600/0x3e734462ed653d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed653d0 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510500.531510:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83033600/0x3e734462ed655d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed655cf expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510500.531521:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a90eae600/0x3e734462ed655e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed655dd expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510500.531537:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81678800/0x3e734462ed65199 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed65192 expref: 5 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510500.531552:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81533c00/0x3e734462ed65383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed6537c expref: 4 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510500.531564:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81532c00/0x3e734462ed65391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed6538a expref: 3 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510500.531574:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a81533800/0x3e734462ed6539f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e734462ed65398 expref: 2 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510500.531584:0:5809:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff929a84fd5800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788510500.531598:0:5809:0:(genops.c:885:class_export_put()) final put ffff929a84fd5800/040cea51-0882-49ef-ac64-3cc6497ba05a 00000020:00000080:3.0:1788510500.531846:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab4e94800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788510500.531878:0:5816:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff929a90ebf000:5816] 2 exiting: rc = 0 00000100:00100000:3.0:1788510500.531988:0:5814:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff929a82d5aa00:5814] 0 exiting: rc = 1 00000100:00100000:0.0:1788510500.532087:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532094:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532100:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532106:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532111:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532116:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532123:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532129:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532135:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532140:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532146:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532151:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532157:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532163:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532314:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532322:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532328:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532334:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532341:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532348:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532353:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532359:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532365:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532371:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532377:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532383:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532389:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532395:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532410:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532416:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532421:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532427:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532433:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532439:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532444:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532451:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532457:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532463:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532469:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532474:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532480:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532486:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532492:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532497:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532503:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532508:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532513:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532519:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532524:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532530:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532535:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532542:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532548:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532554:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532560:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532566:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532572:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532578:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532583:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532589:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532594:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532600:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532606:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.532866:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788510500.533373:0:13053:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788510500.533376:0:13053:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:2.0:1788510500.534267:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510500.534271:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510500.534273:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788510500.534430:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929a84fd5800/040cea51-0882-49ef-ac64-3cc6497ba05a for MGS 00000020:00000080:3.0:1788510500.534470:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929a84fd6800 for MGS 00000020:01000000:0.0:1788510500.535902:0:13053:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff929a82d21060 - data ffff929ab3fcb5e8/ffff929aaf38d400 00000020:01000000:0.0:1788510500.536069:0:13053:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff929a833fb120 - data ffff929a9eb56798/ffff929a90f0a400 00000020:00000080:3.0:1788510500.537491:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65065 00000020:00000080:3.0:1788510500.537502:0:13053:0:(genops.c:885:class_export_put()) final put ffff929a82fba800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788510500.537554:0:13053:0:(tgt_mount.c:187:server_put_mount()) put mount ffff929a82ae6000 from MGS, refs=2 00000020:01000004:3.0:1788510500.537558:0:13053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff929a82ae6000 2 00000020:01000004:3.0:1788510500.537561:0:13053:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff929a82ae6000 from MGS 00000020:00000080:3.0:1788510500.537584:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788510500.537590:0:13053:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788510500.537593:0:13053:0:(genops.c:885:class_export_put()) final put ffff929a82fbc800/MGS 00000020:00000080:3.0:1788510500.537595:0:13053:0:(genops.c:844:class_export_destroy()) destroying export ffff929a82fbc800/MGS for MGS 00000020:01000000:3.0:1788510500.537602:0:13053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788510500.537679:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788510500.537693:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788510500.537701:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788510500.537708:0:13053:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff929ab4e97000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788510500.537714:0:13053:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff929ab4e83380) has exports, disconnecting them 00000020:00080000:3.0:1788510500.537719:0:13053:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff929ab4e97000), last request at 1788510258 00000020:00000080:3.0:1788510500.537724:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65130 00000020:00080000:3.0:1788510500.537731:0:13053:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff929ab4e97000): rc 0 00000020:00000080:3.0:1788510500.537737:0:13053:0:(genops.c:885:class_export_put()) final put ffff929ab4e97000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788510500.537883:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff929a82fba800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788510500.538665:0:13053:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788510500.538698:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788510500.538704:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788510500.538712:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788510500.539349:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab4e97000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788510500.540757:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788510500.540886:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788510500.540894:0:13053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff929a82ae6000 1 00000020:00000080:3.0:1788510500.540903:0:13053:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65057 00000020:00000080:3.0:1788510500.540911:0:13053:0:(genops.c:885:class_export_put()) final put ffff929a82fbe800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788510500.541107:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929aade30800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788510500.541116:0:36:0:(genops.c:885:class_export_put()) final put ffff929ab4e90000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788510500.541119:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab4e90000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788510500.541126:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1788510500.541266:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788510500.541272:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788510500.541277:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788510500.541281:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff929a82d2b380) has no exports 00000020:00000080:0.0:1788510500.541419:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff929a82fbe800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788510500.563277:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788510500.563295:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788510500.563302:0:13053:0:(genops.c:885:class_export_put()) final put ffff929a88169000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788510500.563307:0:13053:0:(genops.c:844:class_export_destroy()) destroying export ffff929a88169000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788510500.563314:0:13053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788510500.563468:0:13053:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff929a82ae5800 00000020:01000000:0.0:1788510500.563496:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788510500.563502:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788510500.563508:0:13053:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788510500.563513:0:13053:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff929a84fb99c0) has no exports 00000100:00100000:0.0:1788510500.563599:0:9544:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff929a83006000:9544] 3 exiting: rc = 0 00000100:00100000:0.0:1788510500.565285:0:5822:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff929a91b7fa00:5822] 1 exiting: rc = 0 00000100:00100000:0.0:1788510500.565378:0:5821:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff929a88b3d800:5821] 0 exiting: rc = 1 00000100:00100000:1.0:1788510500.565554:0:5823:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff929a82d25000:5823] 2 exiting: rc = 0 00000100:00100000:0.0:1788510500.565792:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565799:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565804:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565810:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565814:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565898:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565906:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565912:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565921:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565926:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565931:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565937:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565942:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565947:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565952:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565958:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565977:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565983:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.565989:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566003:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566010:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566025:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566032:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566037:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566042:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566048:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566053:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566059:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566065:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566070:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566076:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566081:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566086:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566090:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566095:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566101:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566107:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566113:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566120:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566125:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566143:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566150:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566156:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566161:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566177:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566183:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566189:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566194:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566199:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566204:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566209:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566213:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566218:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566262:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566268:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566273:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566279:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566284:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566289:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566295:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566300:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566306:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566312:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.566325:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.578916:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff929a91b7e600:5825] 1 exiting: rc = 0 00000100:00100000:0.0:1788510500.579319:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff929a91b7ea00:5824] 0 exiting: rc = 1 00000100:00100000:2.0:1788510500.579425:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579433:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579439:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579456:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579462:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579469:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579475:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579480:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579485:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579490:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579496:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579503:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579510:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579517:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579522:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579527:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579532:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579537:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579543:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579548:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579553:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579559:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579564:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579569:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579574:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579579:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579584:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579590:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579596:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579602:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579620:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579627:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579632:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579645:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579651:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579657:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579662:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579667:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579975:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579985:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.579991:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580006:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580012:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580017:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580022:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580027:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580032:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580037:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580042:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580047:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580051:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580056:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580061:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580065:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580070:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580075:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580081:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580086:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580091:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580096:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580102:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580108:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580113:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.580119:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.581395:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff929a91b0c200:5826] 0 exiting: rc = 1 00000100:00100000:1.0:1788510500.585011:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff929a91b0ca00:5827] 1 exiting: rc = 0 00000100:00100000:2.0:1788510500.585136:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585145:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585151:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585157:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585163:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585178:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585185:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585191:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585211:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585259:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585264:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585270:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585276:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585281:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585289:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585295:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585301:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585307:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585313:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585319:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585341:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585347:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585353:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585358:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585364:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585369:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585375:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585381:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585387:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585393:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585399:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585405:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585425:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585433:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585438:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585444:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585450:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585456:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585461:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585467:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585473:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585479:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585485:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585491:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585515:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585522:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585528:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585533:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585539:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585545:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585551:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585557:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585563:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585568:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585573:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585579:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585598:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585620:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585627:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585642:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585651:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585659:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585665:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.585671:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601481:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff929a91b06000:5829] 1 exiting: rc = 0 00000100:00100000:2.0:1788510500.601536:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff929a91b7f600:5828] 0 exiting: rc = 1 00000100:00100000:0.0:1788510500.601716:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601722:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601728:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601733:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601738:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601744:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601749:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601753:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601839:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601844:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601850:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601856:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601861:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601866:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601871:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601875:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601880:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601885:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601890:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601895:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601900:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601905:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601911:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601916:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601921:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601927:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601932:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601937:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601942:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601947:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601952:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601956:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601960:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601965:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601970:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601975:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601980:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601984:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.601989:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602006:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602012:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602017:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602022:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602035:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602040:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602045:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602050:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602054:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602059:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602064:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602070:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602075:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602080:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602085:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602090:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602095:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602100:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602105:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602110:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602115:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602119:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602125:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602130:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.602135:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.606511:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff929a91b06a00:5830] 0 exiting: rc = 1 00000100:00100000:1.0:1788510500.610403:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff929a91b06600:5831] 1 exiting: rc = 0 00000100:00100000:0.0:1788510500.610474:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610482:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610488:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610493:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610498:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610503:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610507:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610512:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610517:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610522:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610526:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610531:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610536:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610553:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610557:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610562:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610567:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610571:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610576:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610580:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610584:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610589:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610593:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610598:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610603:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610618:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610623:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610627:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610631:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610643:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610647:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610651:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610656:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610661:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610665:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610670:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610848:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610858:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610864:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610870:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610875:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610880:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610885:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610890:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610895:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610901:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610906:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610911:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610923:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610928:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610933:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610939:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610944:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610949:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610954:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610959:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610964:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610969:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610974:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610980:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610984:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.610989:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.611006:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.611012:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.611840:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff929a91b07c00:5833] 1 exiting: rc = 0 00000100:00100000:2.0:1788510500.612131:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff929a91b07200:5832] 0 exiting: rc = 1 00000100:00100000:0.0:1788510500.612435:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612441:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612446:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612451:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612456:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612463:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612468:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612473:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612478:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612483:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612488:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612494:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612498:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612504:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612509:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612515:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612520:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612525:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612918:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612927:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612931:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612936:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612940:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612944:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612948:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612953:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612957:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612961:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612966:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612970:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612974:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612978:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612983:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.612987:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613026:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613032:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613037:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613041:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613046:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613051:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613056:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613061:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613065:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613071:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613076:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613081:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613085:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613090:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613095:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613101:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613107:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613112:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613118:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613132:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613137:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613142:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613146:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613150:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613154:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613159:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613163:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613180:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613185:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510500.613190:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.614327:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff929a91b07000:5834] 0 exiting: rc = 1 00000100:00100000:0.0:1788510500.617002:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff929a91b06c00:5835] 1 exiting: rc = 0 00000100:00100000:0.0:1788510500.617364:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff929a89016a00:5836] 2 exiting: rc = 0 00000100:00100000:2.0:1788510500.618142:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618152:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618158:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618176:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618183:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618191:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618197:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618203:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618210:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618215:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618353:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618362:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618391:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618398:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618403:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618408:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618414:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618419:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618425:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618431:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618437:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618441:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618448:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618454:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618459:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618466:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618472:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618478:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618484:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618490:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618496:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618501:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618506:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618511:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618515:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618521:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618540:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618547:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618552:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618558:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618563:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618568:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618574:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618579:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618585:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618591:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618597:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618868:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618874:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618879:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618884:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618889:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618894:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618900:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618905:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618911:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618916:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618922:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618927:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618932:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618938:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618943:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618949:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788510500.618962:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788510500.631958:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788510500.631974:0:13053:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788510500.631981:0:13053:0:(genops.c:885:class_export_put()) final put ffff929a82ced000/MDS_uuid 00000020:00000080:2.0:1788510500.631986:0:13053:0:(genops.c:844:class_export_destroy()) destroying export ffff929a82ced000/MDS_uuid for MDS 00000020:01000000:2.0:1788510500.632003:0:13053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788510500.632156:0:13053:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788510501.257339:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510501.573124:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861078528:0@lo:400:kworker.0 00000100:00100000:3.0:1788510501.573178:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861078656:0@lo:400:kworker.0 00000400:00000100:0.0:1788510501.573181:0:3291:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875388861078528 offset 0 length 224: 4 00000400:00000100:3.0:1788510501.573200:0:3288:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875388861078656 offset 0 length 224: 4 00000100:00100000:1.0:1788510501.573274:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861078400:0@lo:400:kworker.0 00000400:00000100:1.0:1788510501.573299:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875388861078400 offset 0 length 224: 4 00000001:00100000:1.0:1788510502.197878:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788510502.197892:0:6692:0:(genops.c:885:class_export_put()) final put ffff9299811a2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788510502.198013:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9299811a2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788510502.198324:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9299811a4800 for lustre-OST0000 00010000:00010000:2.0:1788510502.278060:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510503.300460:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788510504.192348:0:13207:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788510504.200362:0:13207:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788510504.200424:0:13207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510504.200441:0:13207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510504.200449:0:13207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510504.200474:0:13207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510504.200512:0:13207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788510504.200518:0:13207:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788510504.200546:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510504.200553:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510504.200561:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80030800 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:2.0:1788510504.200564:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510504.200572:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788510504.200579:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510504.200585:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788510504.200588:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788510504.200591:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788510504.200631:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510504.200637:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788510504.200672:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510504.200680:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a80030800/0x3e734462ed65398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e734462ed6539f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510504.200699:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510504.200701:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510504.200703:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788510504.200719:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788510504.200731:0:13207:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaea78a80 x1875388861078528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510517 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510504.200748:0:13207:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788510504.200783:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861078528:0@lo:400:kworker.0 00000100:00080000:2.0:1788510504.200814:0:13207:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788510504.200830:0:13207:0:(import.c:65:import_set_state_nolock()) ffff92998185f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788510504.200904:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1875388861078912:0@lo:39:umount.0 00000400:00000100:0.0:1788510504.200972:0:3287:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875388861078912 offset 0 length 224: 4 00000100:00100000:1.0:1788510504.201251:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861078784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510504.201587:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510504.202851:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861078784 00000100:00100000:2.0:1788510504.202866:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861078784 00000100:00100000:2.0:1788510504.202921:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788510504.202929:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a84cff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3289:x1875388861078784:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788510504.202946:0:12964:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788510504 with bad export cookie 281250977772097665 00000100:00100000:2.0:1788510504.220735:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a84cff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3289:x1875388861078784:12345-0@lo:103:ldlm_bl.0 Request processed in 17792us (19134us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788510504.220750:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788510504.220887:0:3289:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788510504.220892:0:3289:0:(import.c:65:import_set_state_nolock()) ffff929a82ce8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788510504.220895:0:3289:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788510504.229714:0:3289:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.104@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788510504.229737:0:3289:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788510504.229747:0:3289:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaea78700 x1875388861078400/t0(0) o400->MGC192.168.201.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788510517 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510504.229781:0:3289:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaea7a300 x1875388861078784/t0(0) o103->MGC192.168.201.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788510520 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788510504.229792:0:3289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788510504.229795:0:3289:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788510504.229796:0:3289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788510504.229799:0:3289:0:(import.c:65:import_set_state_nolock()) ffff929a82ce8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788510504.229804:0:3289:0:(import.c:545:import_select_connection()) MGC192.168.201.104@tcp: connect to NID 0@lo last attempt 115 00000100:00080000:1.0:1788510504.229813:0:3289:0:(import.c:665:import_select_connection()) MGC192.168.201.104@tcp: import ffff929a82ce8800 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:2.0:1788510504.229846:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:040cea51-0882-49ef-ac64-3cc6497ba05a:3290:1875388861078400:0@lo:400:kworker.0 00000100:00100000:0.0:1788510504.229927:0:3289:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929abb1e4380 x1875388861079040/t0(0) o250->MGC192.168.201.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788510504.229967:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:040cea51-0882-49ef-ac64-3cc6497ba05a:3289:1875388861078784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510504.230198:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:040cea51-0882-49ef-ac64-3cc6497ba05a:3287:1875388861079040:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1788510504.230279:0:3287:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875388861079040 offset 0 length 520: 4 00010000:00010000:0.0:1788510504.325360:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510505.354588:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510506.372448:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788510506.692380:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 040cea51-0882-49ef-ac64-3cc6497ba05a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788510506.692395:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 040cea51-0882-49ef-ac64-3cc6497ba05a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788510506.692667:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861079168:0@lo:400:kworker.0 00000400:00000100:1.0:1788510506.692741:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875388861079168 offset 0 length 224: 4 00010000:00010000:2.0:1788510507.396565:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510508.420430:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510509.444900:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788510509.700400:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 040cea51-0882-49ef-ac64-3cc6497ba05a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788510509.700434:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 040cea51-0882-49ef-ac64-3cc6497ba05a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788510509.700563:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788510509.700591:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861079296:0@lo:400:kworker.0 00000400:00000100:1.0:1788510509.700659:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875388861079296 offset 0 length 224: 4 00010000:00010000:0.0:1788510510.468424:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510511.493134:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510512.520966:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510513.540655:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510514.372397:0:3287:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788510504/real 1788510504] req@ffff929abb1e4380 x1875388861079040/t0(0) o250->MGC192.168.201.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788510514 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510514.372433:0:3287:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff929abb1e4380 x1875388861079040/t0(0) o250->MGC192.168.201.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788510514 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510514.372445:0:3287:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788510504/real 1788510504] req@ffff929aaea78a80 x1875388861078912/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788510514 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510514.372460:0:3287:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff929aaea78a80 x1875388861078912/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788510514 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788510514.372511:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a82ce8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788510514.372537:0:3287:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788510514.372541:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:040cea51-0882-49ef-ac64-3cc6497ba05a:3287:1875388861079040:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1788510514.372548:0:3287:0:(import.c:65:import_set_state_nolock()) ffff92998185f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788510514.372568:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1875388861078912:0@lo:39:umount.0 00000100:00080000:0.0:1788510514.372660:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788510514.372664:0:13207:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788510514.372676:0:13207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788510514.373659:0:13207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510514.373674:0:13207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510514.373681:0:13207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510514.373687:0:13207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510514.373717:0:13207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788510514.373725:0:13207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510514.373732:0:13207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510514.373738:0:13207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510514.373743:0:13207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510514.373775:0:13207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788510514.373780:0:13207:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788510514.373802:0:13207:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788510514.373806:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788510514.373811:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788510514.373823:0:13207:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788510514.373828:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9299811ab380) has no exports 00000020:00080000:0.0:1788510514.373854:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9299811ab380) has no exports 00000020:01000000:0.0:1788510514.375516:0:13207:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff929a8634fa80 - data ffff9299815e2af8/ffff929aaf3b6800 00000020:01000000:0.0:1788510514.375637:0:13207:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff929a84d65120 - data ffff929a9eb7ebd0/ffff9299819d2000 00010000:00010000:3.0:1788510514.375966:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788510514.375974:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510514.375985:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd400 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510514.375989:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510514.376000:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510514.376007:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510514.376044:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788510514.376047:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788510514.376050:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788510514.376064:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff929a82ce8800 00010000:00010000:3.0:1788510514.376068:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510514.376075:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a813fd400/0x3e734462ed653a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed653ad expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510514.376088:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510514.376091:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510514.376098:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032800 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510514.376101:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510514.376108:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510514.376115:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510514.376121:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788510514.376123:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788510514.376125:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788510514.376129:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff929a82ce8800 00010000:00010000:3.0:1788510514.376132:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510514.376143:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a83032800/0x3e734462ed655dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed655e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510514.376151:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510514.376153:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510514.376155:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788510514.376355:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 040cea51-0882-49ef-ac64-3cc6497ba05a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788510514.376361:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788510514.376365:0:37:0:(import.c:65:import_set_state_nolock()) ffff929a82ce8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788510514.376373:0:37:0:(import.c:545:import_select_connection()) MGC192.168.201.104@tcp: connect to NID 0@lo last attempt 362 00000100:00080000:2.0:1788510514.376379:0:37:0:(import.c:630:import_select_connection()) MGC192.168.201.104@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788510514.376384:0:37:0:(import.c:665:import_select_connection()) MGC192.168.201.104@tcp: import ffff929a82ce8800 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:2.0:1788510514.376421:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929aaea78000 x1875388861079424/t0(0) o250->MGC192.168.201.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788510514.376508:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861079552:0@lo:400:kworker.0 00000400:00000100:2.0:1788510514.376557:0:3288:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875388861079552 offset 0 length 224: 4 00000100:00100000:3.0:1788510514.376721:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:040cea51-0882-49ef-ac64-3cc6497ba05a:3287:1875388861079424:0@lo:250:kworker.0 00000400:00000100:3.0:1788510514.376744:0:3287:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875388861079424 offset 0 length 520: 4 00010000:00010000:1.0:1788510514.376827:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788510514.390037:0:13207:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788510514.416858:0:13207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed651b5 00000020:00000080:3.0:1788510514.416873:0:13207:0:(genops.c:885:class_export_put()) final put ffff929a90ff1800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788510514.416899:0:13207:0:(tgt_mount.c:187:server_put_mount()) put mount ffff929ab4b11000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788510514.416903:0:13207:0:(obd_mount.c:710:lustre_put_lsi()) put ffff929ab4b11000 2 00000020:01000004:3.0:1788510514.416907:0:13207:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff929ab4b11000 from lustre-OST0000 00000020:00000080:3.0:1788510514.416934:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788510514.416948:0:13207:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788510514.416950:0:13207:0:(genops.c:885:class_export_put()) final put ffff929aae6a7800/lustre-OST0000_UUID 00000020:00000080:3.0:1788510514.416953:0:13207:0:(genops.c:844:class_export_destroy()) destroying export ffff929aae6a7800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788510514.416964:0:13207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788510514.417004:0:13207:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788510514.417008:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788510514.417012:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788510514.417017:0:13207:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788510514.417034:0:13207:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff92998185e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788510514.417039:0:13207:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff929981854d40) has exports, disconnecting them 00000020:00080000:3.0:1788510514.417044:0:13207:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff92998185e000), last request at 1788510277 00000020:00000080:3.0:1788510514.417047:0:13207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed651df 00000020:00080000:3.0:1788510514.417056:0:13207:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92998185e000): rc 0 00000020:00000080:3.0:1788510514.417077:0:13207:0:(genops.c:885:class_export_put()) final put ffff92998185e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788510514.417600:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929a90ff1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788510514.417610:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92998185e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788510514.418281:0:13207:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788510514.418286:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788510514.418292:0:13207:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788510514.418297:0:13207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788510514.418379:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92998185f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788510514.418449:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788510514.418455:0:13207:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788510514.418460:0:13207:0:(genops.c:885:class_export_put()) final put ffff929a84e09800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788510514.418464:0:13207:0:(genops.c:844:class_export_destroy()) destroying export ffff929a84e09800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788510514.418474:0:13207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788510514.418534:0:13207:0:(obd_mount.c:710:lustre_put_lsi()) put ffff929ab4b11000 1 00000020:00000080:2.0:1788510514.418538:0:13207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed6516f 00000020:00000080:2.0:1788510514.418544:0:13207:0:(genops.c:885:class_export_put()) final put ffff929aae6a6000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788510514.418560:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788510514.418563:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788510514.418577:0:13207:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788510514.418581:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff929aafdc8000) has no exports 00000020:00000080:0.0:1788510514.419542:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929aae6a6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788510514.454920:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788510514.454945:0:13207:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788510514.455006:0:13207:0:(genops.c:885:class_export_put()) final put ffff929ab4b12800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788510514.455013:0:13207:0:(genops.c:844:class_export_destroy()) destroying export ffff929ab4b12800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788510514.455024:0:13207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788510514.455286:0:13207:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff929ab4b14800 00000020:02000400:0.0:1788510514.455341:0:13207:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788510514.570398:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510515.604257:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510516.629679:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788510517.445449:0:3288:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788510501/real 1788510501] req@ffff929aaea7a680 x1875388861078656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788510517 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510517.469077:0:3288:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff929aaea7a680 x1875388861078656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788510517 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788510517.469094:0:3288:0:(import.c:65:import_set_state_nolock()) ffff929981ead000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788510517.469097:0:3288:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788510517.484549:0:3288:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1788510517.484640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 040cea51-0882-49ef-ac64-3cc6497ba05a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788510517.484646:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 040cea51-0882-49ef-ac64-3cc6497ba05a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788510517.484649:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788510517.484652:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788510517.484656:0:37:0:(import.c:65:import_set_state_nolock()) ffff929981ead000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788510517.484664:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 156 00000100:00080000:3.0:1788510517.484674:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff929981ead000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:3.0:1788510517.485442:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929aaf0ddc00 x1875388861079680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788510517.485551:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1875388861079680:0@lo:38:kworker.0 00000400:00000100:3.0:1788510517.485602:0:3287:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875388861079680 offset 0 length 520: 4 00000100:00100000:3.0:1788510517.485666:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861078656:0@lo:400:kworker.0 00010000:00010000:1.0:1788510517.636759:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788510517.914476:0:13358:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788510517.928932:0:13358:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788510517.929041:0:13358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.929059:0:13358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.929068:0:13358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.929096:0:13358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.929129:0:13358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788510517.929136:0:13358:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788510517.929165:0:13358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788510517.929180:0:13358:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaea78700 x1875388861079168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510522 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510517.929204:0:13358:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaea79880 x1875388861079296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510525 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510517.929213:0:13358:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaea78380 x1875388861079552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510530 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510517.929257:0:13358:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaf0ddc00 x1875388861079680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788510527 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510517.929277:0:13358:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788510517.929285:0:13358:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788510517.929292:0:13358:0:(import.c:65:import_set_state_nolock()) ffff929981ead000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788510517.929297:0:13358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788510517.929301:0:13358:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaea78700 x1875388861079168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510522 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510517.929308:0:13358:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaea79880 x1875388861079296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510525 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510517.929316:0:13358:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaea78380 x1875388861079552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510530 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510517.929322:0:13358:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaf0ddc00 x1875388861079680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788510527 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510517.929350:0:13358:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788510517.929353:0:13358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:3.0:1788510517.929544:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510517.929553:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510517.929573:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80031200 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510517.929577:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510517.929587:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510517.929594:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510517.929601:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788510517.929604:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788510517.929607:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1788510517.929613:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861079296:0@lo:400:kworker.0 00010000:00010000:3.0:1788510517.929623:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff929a82ce8800 00010000:00010000:3.0:1788510517.929628:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510517.929636:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a80031200/0x3e734462ed6537c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed65383 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510517.929639:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861079168:0@lo:400:kworker.0 00010000:00010000:3.0:1788510517.929657:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510517.929660:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510517.929662:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510517.929685:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861079552:0@lo:400:kworker.0 00000100:00100000:3.0:1788510517.929734:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1875388861079680:0@lo:38:kworker.0 00010000:00010000:0.0:1788510517.931885:0:13358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.931908:0:13358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.931915:0:13358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.931922:0:13358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.931966:0:13358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788510517.931973:0:13358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.931979:0:13358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.933120:0:13358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.933130:0:13358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510517.933200:0:13358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788510517.933207:0:13358:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788510517.933267:0:13358:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788510517.933286:0:13358:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788510517.933292:0:13358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788510517.933298:0:13358:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788510517.933302:0:13358:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff929ab4e80000) has no exports 00000020:00080000:0.0:1788510517.933347:0:13358:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff929ab4e80000) has no exports 00000020:01000000:0.0:1788510517.943542:0:13358:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff929a8634f1e0 - data ffff9299815e2a20/ffff929ab5020c00 00000020:01000000:0.0:1788510517.943762:0:13358:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9299838ed000 - data ffff929a9eb1e438/ffff929982443400 00010000:00010000:1.0:1788510517.943919:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788510517.943929:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510517.944404:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a80031400 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510517.944410:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510517.944423:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510517.944431:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510517.944437:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788510517.944440:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788510517.944464:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788510517.944489:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff929a82ce8800 00010000:00010000:1.0:1788510517.944493:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510517.944500:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a80031400/0x3e734462ed6538a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed65391 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510517.944513:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510517.944518:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510517.944523:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77600 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510517.944526:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510517.944532:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510517.944537:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510517.944543:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788510517.944545:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788510517.944547:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788510517.944552:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff929a82ce8800 00010000:00010000:1.0:1788510517.944555:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510517.944562:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929aaec77600/0x3e734462ed655cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed655d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510517.945209:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510517.945213:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510517.945216:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510517.952881:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788510517.971164:0:13358:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788510518.035379:0:13358:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65280 00000020:00000080:1.0:1788510518.035392:0:13358:0:(genops.c:885:class_export_put()) final put ffff929aaf3a0800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788510518.035418:0:13358:0:(tgt_mount.c:187:server_put_mount()) put mount ffff929a85c6b800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788510518.035422:0:13358:0:(obd_mount.c:710:lustre_put_lsi()) put ffff929a85c6b800 2 00000020:01000004:1.0:1788510518.035425:0:13358:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff929a85c6b800 from lustre-OST0001 00000020:00000080:1.0:1788510518.035449:0:13358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788510518.035460:0:13358:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788510518.035463:0:13358:0:(genops.c:885:class_export_put()) final put ffff929aaf3a6800/lustre-OST0001_UUID 00000020:00000080:1.0:1788510518.035466:0:13358:0:(genops.c:844:class_export_destroy()) destroying export ffff929aaf3a6800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788510518.035475:0:13358:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788510518.035584:0:13358:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 040cea51-0882-49ef-ac64-3cc6497ba05a->MGS 00010000:00010000:1.0:1788510518.035602:0:13358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed65192 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed65199 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510518.035617:0:13358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed65192 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed65199 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510518.035624:0:13358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788510518.035627:0:13358:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788510518.035630:0:13358:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788510518.035645:0:13358:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff929a82ce8800 00010000:00010000:1.0:1788510518.035649:0:13358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a81679000/0x3e734462ed65192 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed65199 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510518.035667:0:13358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed653d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e734462ed653d7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510518.035704:0:13358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed653d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e734462ed653d7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510518.035709:0:13358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788510518.035711:0:13358:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788510518.035712:0:13358:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788510518.035722:0:13358:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff929a82ce8800 00010000:00010000:1.0:1788510518.035726:0:13358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a80031e00/0x3e734462ed653d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e734462ed653d7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788510518.035746:0:13358:0:(import.c:65:import_set_state_nolock()) ffff929a82ce8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788510518.035750:0:13358:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788510518.035754:0:13358:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788510518.035755:0:13358:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788510518.035761:0:13358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788510518.035777:0:13358:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff929aaea78000 x1875388861079424/t0(0) o250->MGC192.168.201.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788510529 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788510518.035800:0:13358:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788510518.035803:0:13358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000020:00000080:3.0:1788510518.035851:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929aaf3a0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1788510518.035876:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:040cea51-0882-49ef-ac64-3cc6497ba05a:3287:1875388861079424:0@lo:250:kworker.0 10000000:01000000:1.0:1788510518.036290:0:13358:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788510518.036298:0:13358:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed65073 00000020:00000080:1.0:1788510518.036305:0:13358:0:(genops.c:885:class_export_put()) final put ffff929a82ce8000/040cea51-0882-49ef-ac64-3cc6497ba05a 00000020:01000000:1.0:1788510518.036322:0:13358:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.104@tcp (flags='') 00000020:00000080:1.0:1788510518.036328:0:13358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788510518.036333:0:13358:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.104@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788510518.036338:0:13358:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff929a84fbcd40) has no exports 00000020:00000080:3.0:1788510518.036386:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929a82ce8000/040cea51-0882-49ef-ac64-3cc6497ba05a for MGC192.168.201.104@tcp 10000000:01000000:0.0:1788510518.036641:0:5818:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788510518.038007:0:13358:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.104@tcp: client import never connected 00000100:00080000:1.0:1788510518.038014:0:13358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788510518.038018:0:13358:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788510518.038022:0:13358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788510518.038025:0:13358:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788510518.038111:0:13358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788510518.038120:0:13358:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.104@tcp (uuid 040cea51-0882-49ef-ac64-3cc6497ba05a) 00000020:01000000:1.0:1788510518.038128:0:13358:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788510518.038133:0:13358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788510518.038138:0:13358:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788510518.038145:0:13358:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff929981eab800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788510518.038150:0:13358:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff929aafdcb380) has exports, disconnecting them 00000020:00080000:1.0:1788510518.038154:0:13358:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff929981eab800), last request at 1788510298 00000020:00000080:1.0:1788510518.038159:0:13358:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed652aa 00000020:00080000:1.0:1788510518.038175:0:13358:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff929981eab800): rc 0 00000020:00000080:1.0:1788510518.038180:0:13358:0:(genops.c:885:class_export_put()) final put ffff929981eab800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788510518.038963:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929a82ce8800 for MGC192.168.201.104@tcp 00000020:00000080:3.0:1788510518.038974:0:37:0:(genops.c:885:class_export_put()) final put ffff929a82ceb800/040cea51-0882-49ef-ac64-3cc6497ba05a 00000020:00000080:3.0:1788510518.038977:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929a82ceb800/040cea51-0882-49ef-ac64-3cc6497ba05a for MGC192.168.201.104@tcp 00000020:01000000:3.0:1788510518.038988:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.104@tcp (040cea51-0882-49ef-ac64-3cc6497ba05a) 00000020:00000080:3.0:1788510518.039253:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929981eab800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788510518.040299:0:13358:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788510518.040313:0:13358:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788510518.040318:0:13358:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788510518.040325:0:13358:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788510518.042903:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff929981ead000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788510518.054139:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788510518.057146:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1788510518.057778:0:5804:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff929a88b3c400:5804] 0 exiting: rc = 1 00000100:00100000:3.0:1788510518.058302:0:5805:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff929a88b3d400:5805] 1 exiting: rc = 0 00000100:00100000:2.0:1788510518.059121:0:7609:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff929ab4ca8c00:7609] 2 exiting: rc = 0 00000100:00100000:3.0:1788510518.060261:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.063575:0:5808:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff929a8544fa00:5808] 2 exiting: rc = 0 00000100:00100000:0.0:1788510518.063824:0:5806:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff929aac64d800:5806] 0 exiting: rc = 1 00000100:00100000:2.0:1788510518.071729:0:12964:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff929981146000:12964] 3 exiting: rc = 0 00000100:00100000:2.0:1788510518.071847:0:5807:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff929a88b3da00:5807] 1 exiting: rc = 0 00000100:00100000:3.0:1788510518.076682:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076707:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076713:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076719:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076726:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076732:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076739:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076745:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076751:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076766:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076773:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076778:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076784:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076790:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076796:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076802:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076809:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076815:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076820:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076825:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076830:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076835:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076840:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076863:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076868:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076872:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076877:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076882:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076887:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076893:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076898:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076903:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076908:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076912:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076917:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076921:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076926:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076931:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076935:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076940:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076945:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076950:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076955:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076960:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076965:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076970:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076975:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076980:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076985:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076989:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076994:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.076999:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077004:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077009:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077014:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077019:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077025:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077030:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077040:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077044:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077049:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077054:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077059:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.077065:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788510518.084500:0:13358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788510518.084514:0:13358:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788510518.084520:0:13358:0:(genops.c:885:class_export_put()) final put ffff929981eaf800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788510518.084525:0:13358:0:(genops.c:844:class_export_destroy()) destroying export ffff929981eaf800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788510518.084533:0:13358:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788510518.084588:0:13358:0:(obd_mount.c:710:lustre_put_lsi()) put ffff929a85c6b800 1 00000020:00000080:3.0:1788510518.084594:0:13358:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e734462ed6524f 00000020:00000080:3.0:1788510518.084600:0:13358:0:(genops.c:885:class_export_put()) final put ffff929abaac8000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788510518.084620:0:13358:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788510518.084627:0:13358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788510518.084632:0:13358:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788510518.084636:0:13358:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff929ab4e819c0) has no exports 00000020:00000080:0.0:1788510518.086700:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff929abaac8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788510518.136474:0:13358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788510518.136490:0:13358:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788510518.136497:0:13358:0:(genops.c:885:class_export_put()) final put ffff929abaace800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788510518.136501:0:13358:0:(genops.c:844:class_export_destroy()) destroying export ffff929abaace800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788510518.136511:0:13358:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788510518.136723:0:13358:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff929a85c6d000 00000020:01000000:0.0:1788510518.136743:0:13358:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788510518.136747:0:13358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788510518.136751:0:13358:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788510518.136755:0:13358:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff929a84fb8000) has no exports 00000020:00000080:0.0:1788510518.136795:0:13358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788510518.136811:0:13358:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788510518.136815:0:13358:0:(genops.c:885:class_export_put()) final put ffff929aae6a3000/OSS_uuid 00000020:00000080:0.0:1788510518.136818:0:13358:0:(genops.c:844:class_export_destroy()) destroying export ffff929aae6a3000/OSS_uuid for OSS 00000020:01000000:0.0:1788510518.136822:0:13358:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788510518.136851:0:5817:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788510518.137012:0:12047:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff929abaa63600:12047] 4 exiting: rc = 0 00000100:00100000:0.0:1788510518.137089:0:8183:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff929ab4f9cc00:8183] 3 exiting: rc = 0 00000100:00100000:0.0:1788510518.137137:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff929aae6b1200:6670] 2 exiting: rc = 0 00000100:00100000:0.0:1788510518.137183:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff929a83006600:6667] 0 exiting: rc = 1 00000100:00100000:0.0:1788510518.137264:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff929a83006200:6669] 1 exiting: rc = 0 00000100:00100000:0.0:1788510518.137327:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137335:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137346:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137354:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137360:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137365:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137370:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137375:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137380:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137385:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137391:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137396:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137401:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137406:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137411:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137416:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137422:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137427:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137432:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137436:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137441:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137446:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137451:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137457:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137470:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137475:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137480:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137485:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137490:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137495:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137500:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137505:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137512:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137517:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137522:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137528:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137533:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137538:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137544:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137549:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137555:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137560:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137565:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137570:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137575:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137580:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137585:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137590:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137596:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137601:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137606:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137611:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137616:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137621:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137626:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137630:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137635:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137640:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137644:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137655:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137660:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137664:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137668:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.137673:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.138445:0:10289:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff929ab49cfc00:10289] 2 exiting: rc = 0 00000100:00100000:3.0:1788510518.141529:0:6672:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff929a89aa8800:6672] 1 exiting: rc = 0 00000100:00100000:3.0:1788510518.141657:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff929a89aa9e00:6671] 0 exiting: rc = 1 00000100:00100000:0.0:1788510518.143955:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.143968:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.143973:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.143977:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.143982:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.143987:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.143992:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.143997:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.144002:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.144008:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.144013:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.144019:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.144024:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.144029:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.144034:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.144039:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150171:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150211:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150217:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150233:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150239:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150244:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150248:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150254:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150259:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150265:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150269:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150275:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150280:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150815:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150823:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150829:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150834:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150840:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150846:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150851:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150857:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150863:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150868:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150874:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150880:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150904:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150912:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150924:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150930:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150937:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150944:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150950:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150956:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150961:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150966:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150972:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150977:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150982:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150986:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150992:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.150996:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.151002:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.151008:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.151014:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.151019:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.151025:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.151031:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.151036:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.160270:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff929abcf4c000:6675] 2 exiting: rc = 0 00000100:00100000:3.0:1788510518.160503:0:6674:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff929abcf4d800:6674] 1 exiting: rc = 0 00000100:00100000:2.0:1788510518.162065:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff929a89aa9200:6673] 0 exiting: rc = 1 00000100:00100000:0.0:1788510518.162162:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162171:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162177:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162183:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162192:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162199:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162205:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162212:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162217:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162242:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162249:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162269:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162276:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162282:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162288:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162293:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162298:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162304:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162309:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162316:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162322:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162338:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162345:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162351:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162366:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162372:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162379:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162386:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162391:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162396:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162402:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162408:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162414:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162419:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162425:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162456:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162473:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162480:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162487:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162493:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162498:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162504:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162510:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162515:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162521:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162527:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162533:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162537:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162543:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162548:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162554:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162560:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162566:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162571:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162578:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162583:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162589:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162595:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162601:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162606:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162612:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162617:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162622:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.162635:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.212268:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff929abcf4c600:6677] 1 exiting: rc = 0 00000100:00100000:3.0:1788510518.213206:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff929abcf4ca00:6676] 0 exiting: rc = 1 00000100:00100000:0.0:1788510518.215242:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215252:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215258:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215263:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215268:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215284:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215289:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215293:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215298:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215304:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215310:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215315:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.215323:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216623:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216641:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216648:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216652:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216657:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216662:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216667:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216673:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216678:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216683:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216698:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216704:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216710:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216716:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216722:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216727:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216732:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216737:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216743:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216748:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216754:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216770:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216776:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216781:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216786:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216791:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216797:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216818:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216823:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216829:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216834:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216842:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216847:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216853:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216859:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216864:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216870:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216875:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216881:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216885:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216890:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216896:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216901:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.216906:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.217573:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.217581:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.217586:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.217591:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.217595:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.217601:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788510518.217606:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.220370:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff929abcf4d200:6678] 0 exiting: rc = 1 00000100:00100000:0.0:1788510518.223160:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff929abcf4dc00:6679] 1 exiting: rc = 0 00000100:00100000:3.0:1788510518.223275:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223285:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223291:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223297:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223314:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223342:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223349:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223355:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223378:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223385:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223391:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223398:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223522:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223534:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223541:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223550:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223558:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223581:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223588:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223594:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223600:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223606:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223612:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223617:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223622:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223628:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223634:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223641:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223647:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223666:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223672:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223678:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223684:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223702:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223708:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223713:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223719:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223724:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223731:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223737:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223743:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223764:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223771:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223783:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223789:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223796:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223805:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223811:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223818:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223825:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223833:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223842:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223848:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223872:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223880:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223887:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223894:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223899:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223906:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223911:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223918:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223925:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223933:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788510518.223940:0:13358:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788510518.316622:0:13358:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788510539.668872:0:13973:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788510550.692570:0:14433:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788510550.692576:0:14433:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788510550.692701:0:14433:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff929aaeb69800 00000020:01000004:0.0:1788510550.692927:0:14433:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788510550.692936:0:14433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788510550.692951:0:14433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9299818519c0) 00000020:00000080:0.0:1788510550.692967:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788510550.710375:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788510550.713050:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788510550.713449:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1788510550.713554:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1788510550.713639:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1788510550.713738:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1788510550.714201:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788510550.714383:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1788510550.714485:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1788510550.715035:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1788510550.716420:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 775: rc = 0 00100000:10000000:1.0:1788510550.716695:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 775: rc = 0 00100000:10000000:1.0:1788510550.717426:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 778: rc = 0 00100000:10000000:1.0:1788510550.718051:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 778: rc = 0 00100000:10000000:1.0:1788510550.718465:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 778: rc = 0 00100000:10000000:1.0:1788510550.719048:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 778: rc = 0 00100000:10000000:1.0:1788510550.719393:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 778: rc = 0 00100000:10000000:1.0:1788510550.719944:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 778: rc = 0 00100000:10000000:1.0:1788510550.720218:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 778: rc = 0 00100000:10000000:1.0:1788510550.720664:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 778: rc = 0 00100000:10000000:1.0:1788510550.721159:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 778: rc = 0 00100000:10000000:1.0:1788510550.721451:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 778: rc = 0 00100000:10000000:1.0:1788510550.721979:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 778: rc = 0 00100000:10000000:1.0:1788510550.722366:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 778: rc = 0 00100000:10000000:1.0:1788510550.724937:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 552: rc = 0 00100000:10000000:1.0:1788510550.725204:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 552: rc = 0 00100000:10000000:1.0:1788510550.725554:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 552: rc = 0 00100000:10000000:2.0:1788510550.726505:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 552: rc = 0 00100000:10000000:2.0:1788510550.727007:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 552: rc = 0 00100000:10000000:2.0:1788510550.727305:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 552: rc = 0 00100000:10000000:2.0:1788510550.727663:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 552: rc = 0 00100000:10000000:2.0:1788510550.728141:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 552: rc = 0 00100000:10000000:2.0:1788510550.728512:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 552: rc = 0 00100000:10000000:2.0:1788510550.729032:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 552: rc = 0 00100000:10000000:2.0:1788510550.729351:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 552: rc = 0 00100000:10000000:2.0:1788510550.729912:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 552: rc = 0 00100000:10000000:2.0:1788510550.730174:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 552: rc = 0 00100000:10000000:2.0:1788510550.730677:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 552: rc = 0 00100000:10000000:2.0:1788510550.731166:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 552: rc = 0 00100000:10000000:2.0:1788510550.731464:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 552: rc = 0 00100000:10000000:2.0:1788510550.732002:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 552: rc = 0 00100000:10000000:2.0:1788510550.732487:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 552: rc = 0 00100000:10000000:2.0:1788510550.733049:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 552: rc = 0 00100000:10000000:2.0:1788510550.733461:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 552: rc = 0 00100000:10000000:2.0:1788510550.734024:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 552: rc = 0 00100000:10000000:2.0:1788510550.735379:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 552: rc = 0 00100000:10000000:2.0:1788510550.736627:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 552: rc = 0 00100000:10000000:2.0:1788510550.736994:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 552: rc = 0 00100000:10000000:2.0:1788510550.737309:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 552: rc = 0 00100000:10000000:2.0:1788510550.737559:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 552: rc = 0 00100000:10000000:2.0:1788510550.737811:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 552: rc = 0 00100000:10000000:2.0:1788510550.738058:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 552: rc = 0 00100000:10000000:2.0:1788510550.738376:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 552: rc = 0 00100000:10000000:2.0:1788510550.738639:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 552: rc = 0 00100000:10000000:2.0:1788510550.738876:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 552: rc = 0 00100000:10000000:2.0:1788510550.739156:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 552: rc = 0 00100000:10000000:2.0:1788510550.739620:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 792: rc = 0 00100000:10000000:2.0:1788510550.741087:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788510550.741334:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 776: rc = 0 00100000:10000000:2.0:1788510550.741651:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788510550.741906:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 776: rc = 0 00100000:10000000:2.0:1788510550.742137:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788510550.742211:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 776: rc = 0 00100000:10000000:2.0:1788510550.742906:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788510550.742972:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 653: rc = 0 00100000:10000000:2.0:1788510550.743181:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788510550.743275:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 653: rc = 0 00100000:10000000:2.0:1788510550.743486:0:14433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788510550.743627:0:14433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 653: rc = 0 00000020:00000080:2.0:1788510550.744094:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788510550.744104:0:14433:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788510550.744118:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed66374 00000020:01000004:2.0:1788510550.744139:0:14433:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788510550.744152:0:14433:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788510550.744159:0:14433:0:(tgt_mount.c:101:server_register_mount()) register mount ffff929aaeb69800 from MGS 00000020:01000004:2.0:1788510550.744164:0:14433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788510550.744175:0:14433:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9299811acd40) 00000020:00000080:2.0:1788510550.744187:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788510550.744405:0:14433:0:(tgt_mount.c:153:server_get_mount()) get mount ffff929aaeb69800 from MGS, refs=2 00080000:01000000:2.0:1788510550.744410:0:14433:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788510550.744416:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed66382 00000100:00100000:2.0:1788510550.744593:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788510550.744912:0:14433:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788510550.744919:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788510550.745386:0:14433:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788510550.745391:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788510550.746182:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510550.746991:0:14433:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788510550.746999:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788510550.747986:0:14433:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788510550.747996:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788510550.748455:0:14433:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788510550.748462:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788510550.749443:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510550.749447:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510550.749449:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510550.750068:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510550.750072:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510550.750074:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510550.751028:0:14433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788510550.753389:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788510550.768710:0:14433:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788510550.768730:0:14433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788510550.768733:0:14433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788510550.770963:0:14442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788510550.771109:0:14433:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788510550.772747:0:14433:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788510550.773480:0:14433:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788510550.775174:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788510550.775387:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788510550.775395:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788510550.777254:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788510550.777264:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788510550.786896:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788510550.786909:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788510550.790287:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788510550.790314:0:14433:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.104@tcp' 00000020:01000004:3.0:1788510550.790316:0:14433:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788510550.790349:0:14433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.104@tcp (typ=mgc) 00000020:00000080:3.0:1788510550.790363:0:14433:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.104@tcp (ffff929ab4e819c0) 00000020:00000080:3.0:1788510550.790378:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788510550.790450:0:14433:0:(ldlm_lib.c:102:import_set_conn()) imp ffff929a98412000@MGC192.168.201.104@tcp: add connection 192.168.201.104@tcp at head 00010000:00010000:3.0:1788510550.790656:0:14433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.104@tcp-0 is initialized 00000040:01000000:3.0:1788510550.790663:0:14433:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.104@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788510550.790916:0:14447:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788510550.796920:0:14448:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788510550.798154:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.104@tcp (uuid f4d56e3b-8589-453f-93c5-42174bfbbc5c) 00000020:00000080:3.0:1788510550.798201:0:14433:0:(genops.c:1385:class_connect()) connect: client f4d56e3b-8589-453f-93c5-42174bfbbc5c, cookie 0x3e734462ed66390 00000100:00080000:3.0:1788510550.798241:0:14433:0:(import.c:545:import_select_connection()) MGC192.168.201.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788510550.798252:0:14433:0:(import.c:665:import_select_connection()) MGC192.168.201.104@tcp: import ffff929a98412000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:3.0:1788510550.798305:0:14433:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929aaf0ddc00 x1875388861079808/t0(0) o250->MGC192.168.201.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788510550.798345:0:14433:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f4d56e3b-8589-453f-93c5-42174bfbbc5c->MGS 00000020:01000004:3.0:1788510550.798379:0:14433:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788510550.798386:0:14433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788510550.798404:0:14433:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff929ab4e80000) 00000020:00000080:3.0:1788510550.798419:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788510550.803046:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3287:1875388861079808:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788510550.803158:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510550.804902:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861079808 00000100:00100000:1.0:1788510550.804920:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861079808 00000100:00100000:1.0:1788510550.804968:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788510550.804977:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3287:x1875388861079808:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788510550.805006:0:14443:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f4d56e3b-8589-453f-93c5-42174bfbbc5c@0@lo t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:1.0:1788510550.805042:0:14443:0:(genops.c:1385:class_connect()) connect: client f4d56e3b-8589-453f-93c5-42174bfbbc5c, cookie 0x3e734462ed6639e 00000100:00080000:1.0:1788510550.805214:0:14443:0:(import.c:65:import_set_state_nolock()) ffff929aae937000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788510550.805352:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+5:3287:x1875388861079808:12345-0@lo:250:mount.lustre.0 Request processed in 374us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510550.805360:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510550.808256:0:3287:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788510550.808281:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1788510550.808294:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788510550.808302:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788510550.808307:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a98412000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788510550.808312:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788510550.808330:0:3287:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788510550.808341:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3287:1875388861079808:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788510550.830639:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788510550.830895:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788510550.830903:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788510550.838098:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788510550.838119:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788510550.839574:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788510550.839584:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788510550.840301:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788510550.840519:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788510550.840527:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788510550.841493:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788510550.841504:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788510550.882018:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788510550.882328:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788510550.882337:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788510550.884334:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788510550.884351:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788510550.885372:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788510550.885997:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788510550.886006:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788510550.887079:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788510550.887088:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788510550.888634:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788510550.889074:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788510550.889080:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788510550.890071:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788510550.890079:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788510550.890978:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788510550.891187:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788510550.891192:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788510550.892465:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788510550.892476:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788510550.919019:0:14433:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788510550.919414:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788510550.919422:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788510550.921594:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788510550.921630:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788510550.923882:0:14433:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788510550.923900:0:14433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788510550.927158:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788510550.927186:0:14433:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788510550.927193:0:14433:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788510550.927526:0:14433:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788510550.927578:0:14433:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.104@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788510550.927584:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788510550.927585:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788510550.927587:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510550.927588:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510550.927590:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510550.927597:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510550.927598:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788510550.927600:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788510550.927601:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510550.927602:0:14433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788510550.927605:0:14433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788510550.927607:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788510550.927608:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788510550.927609:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510550.927610:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510550.927611:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510550.927612:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510550.927613:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788510550.927613:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788510550.927614:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510550.927625:0:14433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788510550.927656:0:14433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788510550.927677:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861079936:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788510550.927956:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510550.928049:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89466300 going to sleep for 11 seconds 00000100:00100000:1.0:1788510550.928487:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861079936 00000100:00100000:1.0:1788510550.928499:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861079936 00000100:00100000:1.0:1788510550.928718:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510550.928731:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+5:14433:x1875388861079936:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788510550.928954:0:14446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788510550.928958:0:14446:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788510550.928967:0:14446:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788510550.929333:0:14467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788510550.930192:0:14446:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788510550.932027:0:14468:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788510550.932036:0:14468:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788510550.932039:0:14468:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788510550.932072:0:14468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788510550.933032:0:14446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788510550.933045:0:14446:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788510550.939714:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+5:14433:x1875388861079936:12345-0@lo:253:mount.lustre.0 Request processed in 10964us (11736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510550.939734:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788510550.940040:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861079936:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788510550.940056:0:14433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788510550.940060:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788510550.940062:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788510550.940063:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510550.940064:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510550.940066:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510550.940067:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510550.940069:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788510550.940070:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788510550.940072:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510550.940074:0:14433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788510550.940098:0:14433:0:(tgt_mount.c:101:server_register_mount()) register mount ffff929aaeb69800 from lustre-MDT0000 10000000:01000000:3.0:1788510550.940151:0:14433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788510550.940155:0:14433:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788510550.940160:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff929ab4e819c0 10000000:01000000:3.0:1788510550.940165:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788510550.940174:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff929ab4e819c0 from 1 10000000:01000000:3.0:1788510550.940177:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788510550.940276:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510550.940290:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510550.940304:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510550.940327:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788510550.940383:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510550.940435:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8560b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788510550.940910:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861080064 00000100:00100000:2.0:1788510550.940919:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861080064 00000100:00100000:2.0:1788510550.940974:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510550.940984:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+5:14433:x1875388861080064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788510550.941002:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510550.941019:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929aaec77800/0x3e734462ed663ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed663a5 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510550.941047:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929aaec77800/0x3e734462ed663ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed663a5 expref: 6 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510550.941072:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929aaec77800/0x3e734462ed663ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed663a5 expref: 6 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510550.941083:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77800, rc 0) 00000100:00100000:2.0:1788510550.941148:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+6:14433:x1875388861080064:12345-0@lo:101:mount.lustre.0 Request processed in 165us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510550.941155:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788510550.941272:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788510550.941288:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ac expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510550.941298:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed663ac expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510550.941359:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788510550.941400:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510550.941426:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aa177ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510550.942130:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861080192 00000100:00100000:3.0:1788510550.942139:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861080192 00000100:00100000:3.0:1788510550.942174:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788510550.942183:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+6:14433:x1875388861080192:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788510550.942496:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+6:14433:x1875388861080192:12345-0@lo:501:mount.lustre.0 Request processed in 313us (1094us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788510550.942504:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788510550.942718:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080192:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788510550.942925:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788510550.942943:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ac expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510550.942954:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ac expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510550.942963:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff929aaeb69800 10000000:01000000:1.0:1788510550.942969:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788510550.942974:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff929aaeb69800 10000000:01000000:1.0:1788510550.942985:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788510550.942989:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff929aaeb69800 from 1 10000000:01000000:1.0:1788510550.942992:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788510550.943023:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed663b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510550.943032:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed663b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510550.943041:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed663b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510550.943057:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788510550.943098:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510550.943133:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aa177ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510550.943218:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861080320 00000100:00100000:2.0:1788510550.943252:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861080320 00000100:00100000:2.0:1788510550.943285:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788510550.943294:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+7:14433:x1875388861080320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788510550.943306:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510550.943321:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929aaec77a00/0x3e734462ed663ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed663b3 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510550.943345:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929aaec77a00/0x3e734462ed663ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed663b3 expref: 8 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510550.943356:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929aaec77a00/0x3e734462ed663ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed663b3 expref: 8 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510550.943367:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77a00, rc 0) 00000100:00100000:2.0:1788510550.943413:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+8:14433:x1875388861080320:12345-0@lo:101:mount.lustre.0 Request processed in 120us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510550.943420:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788510550.943882:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788510550.943899:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed663b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ba expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510550.943908:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed663b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed663ba expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510550.943924:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788510550.943934:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed663b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ba expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510550.943941:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a83032e00/0x3e734462ed663b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ba expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510550.943948:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788510550.943963:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788510550.943968:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff929aaeb69800 10000000:01000000:1.0:1788510550.943971:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788510550.943975:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788510550.943978:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788510550.943996:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83033400/0x3e734462ed663c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510550.944004:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a83033400/0x3e734462ed663c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510550.944012:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a83033400/0x3e734462ed663c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510550.944026:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788510550.944054:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510550.944175:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aa177ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510550.944242:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861080448 00000100:00100000:2.0:1788510550.944247:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861080448 00000100:00100000:2.0:1788510550.944287:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788510550.944303:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+7:14433:x1875388861080448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788510550.944313:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510550.944323:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929aaec77000/0x3e734462ed663c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed663c1 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510550.944340:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929aaec77000/0x3e734462ed663c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed663c1 expref: 8 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510550.944348:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929aaec77000/0x3e734462ed663c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed663c1 expref: 8 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510550.944354:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77000, rc 0) 00000100:00100000:2.0:1788510550.944386:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+8:14433:x1875388861080448:12345-0@lo:101:mount.lustre.0 Request processed in 85us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510550.944392:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788510550.944652:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788510550.944664:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a83033400/0x3e734462ed663c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663c8 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510550.944672:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a83033400/0x3e734462ed663c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed663c8 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510550.944735:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788510550.945017:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510550.945049:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929aa177ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510550.945065:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861080576 00000100:00100000:1.0:1788510550.945070:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861080576 00000100:00100000:1.0:1788510550.945104:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788510550.945111:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+8:14433:x1875388861080576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788510550.945730:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+9:14433:x1875388861080576:12345-0@lo:501:mount.lustre.0 Request processed in 618us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510550.946613:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788510550.947118:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788510550.947186:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788510550.947274:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510550.947316:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a91f27480 going to sleep for 11 seconds 00000100:00100000:0.0:1788510550.947781:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861080704 00000100:00100000:0.0:1788510550.947789:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861080704 00000100:00100000:0.0:1788510550.947830:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788510550.947840:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+9:14433:x1875388861080704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788510550.948423:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+9:14433:x1875388861080704:12345-0@lo:503:mount.lustre.0 Request processed in 583us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510550.948430:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788510550.948929:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861080704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788510550.949722:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14469:1875388861080832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510550.949901:0:14469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510550.949939:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a91f27540 going to sleep for 11 seconds 00000100:00100000:0.0:1788510550.950044:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861080832 00000100:00100000:0.0:1788510550.950050:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861080832 00000100:00100000:0.0:1788510550.950090:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788510550.950098:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+9:14469:x1875388861080832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510550.950420:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+9:14469:x1875388861080832:12345-0@lo:502:llog_process_th.0 Request processed in 322us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510550.950428:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788510550.950608:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14469:1875388861080832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788510550.950697:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510550.950715:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510550.950717:0:14469:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788510550.950722:0:14469:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788510550.950724:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788510550.950744:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff929aafdc99c0) 00000020:00000080:1.0:1788510550.950759:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788510550.950904:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788510550.950962:0:14469:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788510550.950968:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed663d6 00000020:00000080:1.0:1788510550.951193:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788510550.951197:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510550.951207:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510550.951209:0:14469:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788510550.951212:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510550.951215:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510550.951216:0:14469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788510550.951219:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788510550.951261:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff929aafdcb380) 00000020:00000080:1.0:1788510550.951271:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788510550.951275:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788510550.951277:0:14469:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788510550.951280:0:14469:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788510550.951286:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788510550.951332:0:14469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff929aaeb69800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788510550.951343:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff929aafdc8000) 00000020:00000080:1.0:1788510550.951350:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788510550.951387:0:14469:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788510550.951391:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e734462ed663eb 00000020:00000080:1.0:1788510550.951469:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788510550.951475:0:14469:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788510550.951478:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e734462ed663f2 00080000:01000000:1.0:1788510550.951482:0:14469:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788510550.951486:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed663f9 00010000:00010000:3.0:1788510551.023504:0:14469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788510551.024886:0:14469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788510551.025366:0:14469:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788510551.027209:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff929ab4e83380) 00000020:00000080:3.0:1788510551.027276:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788510551.027363:0:14469:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788510551.027372:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed66407 00000020:00000080:0.0:1788510551.037941:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788510551.052370:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e734462ed6640e 00000020:00000080:1.0:1788510551.053078:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788510551.053092:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510551.053098:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.053101:0:14469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788510551.053104:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510551.053109:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.053111:0:14469:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788510551.053115:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788510551.053162:0:14469:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788510551.053174:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510551.053185:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.053187:0:14469:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788510551.053190:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788510551.053192:0:14469:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788510551.053194:0:14469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788510551.053195:0:14469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788510551.053197:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788510551.053199:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.053201:0:14469:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788510551.053203:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788510551.053206:0:14469:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788510551.053210:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.053211:0:14469:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788510551.053214:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788510551.053246:0:14469:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.104@tcp to nid 0x20000c0a8c968 (192.168.201.104@tcp) 00000020:01000000:1.0:1788510551.053276:0:14469:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788510551.053279:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788510551.053295:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff929aafdccd40) 00000020:00000080:1.0:1788510551.053310:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788510551.053315:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788510551.053386:0:14469:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788510551.053391:0:14469:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788510551.053397:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed6641c 00010000:00080000:1.0:1788510551.053430:0:14469:0:(ldlm_lib.c:102:import_set_conn()) imp ffff929a82cec000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.104@tcp at head 00010000:00010000:1.0:1788510551.053686:0:14469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788510551.054338:0:14469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788510551.054386:0:14469:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788510551.056506:0:14469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788510551.056871:0:14469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788510551.056956:0:14469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788510551.057673:0:14473:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788510551.057680:0:14473:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788510551.059019:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788510551.059044:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788510551.059101:0:14469:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788510551.059139:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e734462ed66423 00000100:00080000:1.0:1788510551.059153:0:14469:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788510551.059159:0:14469:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff929a82cec000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:1.0:1788510551.059209:0:14469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9299836c7100 x1875388861080960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788510551.059535:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861080960:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788510551.059597:0:3287:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875388861080960 offset 0 length 520: 4 00000100:00080000:1.0:1788510551.059843:0:14469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788510551.059950:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510551.059955:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.059958:0:14469:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788510551.059961:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788510551.059964:0:14469:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788510551.059966:0:14469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788510551.059968:0:14469:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788510551.059969:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788510551.059972:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.059973:0:14469:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788510551.059976:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788510551.059979:0:14469:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788510551.059983:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.059984:0:14469:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788510551.059987:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788510551.059990:0:14469:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.104@tcp to nid 0x20000c0a8c968 (192.168.201.104@tcp) 00000020:01000000:1.0:1788510551.060012:0:14469:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788510551.060015:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788510551.060046:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff929ab6293380) 00000020:00000080:1.0:1788510551.060062:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788510551.060069:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788510551.060151:0:14469:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788510551.060159:0:14469:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788510551.060167:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e734462ed66431 00010000:00080000:1.0:1788510551.060203:0:14469:0:(ldlm_lib.c:102:import_set_conn()) imp ffff929a84ec9000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.104@tcp at head 00010000:00010000:1.0:1788510551.060453:0:14469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788510551.061017:0:14469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788510551.061041:0:14469:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788510551.062418:0:14469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788510551.062865:0:14469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788510551.062957:0:14469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788510551.063579:0:14475:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788510551.063585:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788510551.064666:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788510551.064682:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788510551.064719:0:14469:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788510551.064754:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e734462ed66438 00000100:00080000:1.0:1788510551.065030:0:14469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788510551.065039:0:14469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff929a84ec9000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:1.0:1788510551.065086:0:14469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9299836c5c00 x1875388861081088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788510551.065127:0:14469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788510551.065198:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510551.065203:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.065205:0:14469:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788510551.065208:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510551.065212:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.065214:0:14469:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788510551.065217:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788510551.065219:0:14469:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788510551.065250:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510551.065255:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.065256:0:14469:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788510551.065259:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510551.065262:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510551.065263:0:14469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788510551.065267:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788510551.065308:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14469:1875388861081216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788510551.065424:0:14469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510551.065468:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88701300 going to sleep for 11 seconds 00000100:00100000:0.0:1788510551.065634:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861081088:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788510551.065669:0:3287:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875388861081088 offset 0 length 520: 4 00000100:00100000:0.0:1788510551.065711:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861081216 00000100:00100000:0.0:1788510551.065718:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861081216 00000100:00100000:0.0:1788510551.065946:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788510551.065957:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+9:14469:x1875388861081216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510551.066255:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+9:14469:x1875388861081216:12345-0@lo:502:llog_process_th.0 Request processed in 299us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510551.066263:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788510551.066320:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14469:1875388861081216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788510551.066348:0:14469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788510551.066353:0:14469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788510551.066355:0:14469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788510551.066361:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788510551.066667:0:14433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788510551.066688:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788510551.066710:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83033400/0x3e734462ed663c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663c8 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510551.066721:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a83033400/0x3e734462ed663c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663c8 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510551.066729:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff929aaeb69800 from 1 10000000:01000000:2.0:1788510551.066732:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788510551.066923:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510551.066933:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510551.066952:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510551.066968:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861081344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788510551.067002:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510551.067035:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab5054840 going to sleep for 11 seconds 00000100:00100000:0.0:1788510551.067138:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861081344 00000100:00100000:0.0:1788510551.067143:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861081344 00000100:00100000:0.0:1788510551.067208:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788510551.067216:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82ca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+9:14433:x1875388861081344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788510551.067257:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510551.067287:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eaf600/0x3e734462ed66446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6643f expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510551.067310:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eaf600/0x3e734462ed66446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6643f expref: 10 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510551.067321:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eaf600/0x3e734462ed66446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6643f expref: 10 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510551.067331:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf600, rc 0) 00000100:00100000:0.0:1788510551.067368:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82ca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+10:14433:x1875388861081344:12345-0@lo:101:mount.lustre.0 Request processed in 153us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510551.067375:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788510551.067446:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861081344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788510551.067459:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510551.067468:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510551.068921:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861081472:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788510551.069025:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510551.069989:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab5054840 going to sleep for 11 seconds 00000100:00100000:0.0:1788510551.070159:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861081472 00000100:00100000:0.0:1788510551.070168:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861081472 00000100:00100000:0.0:1788510551.070209:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788510551.070219:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82ca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+10:14433:x1875388861081472:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788510551.070259:0:14443:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788510551.070266:0:14443:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788510551.070357:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82ca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+10:14433:x1875388861081472:12345-0@lo:256:mount.lustre.0 Request processed in 138us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510551.070364:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788510551.070854:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861081472:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788510551.071986:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788510551.072050:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510551.072064:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510551.072074:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929aaeb69800 from 1 10000000:01000000:2.0:1788510551.072076:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788510551.072150:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510551.072159:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510551.072171:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510551.072199:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861081600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788510551.072395:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510551.072474:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab5054840 going to sleep for 11 seconds 00000100:00100000:0.0:1788510551.072530:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861081600 00000100:00100000:0.0:1788510551.072539:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861081600 00000100:00100000:0.0:1788510551.072602:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788510551.072828:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82caac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+10:14433:x1875388861081600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788510551.072850:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510551.072870:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eaf800/0x3e734462ed66454 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6644d expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510551.072908:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eaf800/0x3e734462ed66454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6644d expref: 11 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510551.072920:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eaf800/0x3e734462ed66454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6644d expref: 11 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510551.072930:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf800, rc 0) 00000100:00100000:0.0:1788510551.072974:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82caac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14433:x1875388861081600:12345-0@lo:101:mount.lustre.0 Request processed in 364us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510551.072981:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788510551.073199:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861081600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788510551.073216:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510551.073259:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510551.073335:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861081728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788510551.073366:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510551.073387:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8560b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788510551.073452:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861081728 00000100:00100000:2.0:1788510551.073457:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861081728 00000100:00100000:2.0:1788510551.073488:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788510551.073496:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14433:x1875388861081728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788510551.074167:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14433:x1875388861081728:12345-0@lo:501:mount.lustre.0 Request processed in 670us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510551.074175:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788510551.074357:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861081728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788510551.074392:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861081856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788510551.074431:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510551.074461:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8560b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788510551.074503:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861081856 00000100:00100000:2.0:1788510551.074968:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861081856 00000100:00100000:2.0:1788510551.075016:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788510551.075025:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14433:x1875388861081856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788510551.075363:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14433:x1875388861081856:12345-0@lo:503:mount.lustre.0 Request processed in 337us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510551.075371:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788510551.075505:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861081856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788510551.076093:0:14477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14477:1875388861081984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510551.076144:0:14477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510551.076211:0:14477:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab50546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510551.076414:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861081984 00000100:00100000:0.0:1788510551.076419:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861081984 00000100:00100000:0.0:1788510551.076483:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788510551.076490:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14477:x1875388861081984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788510551.076926:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14477:x1875388861081984:12345-0@lo:502:llog_process_th.0 Request processed in 435us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510551.076934:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788510551.077001:0:14477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14477:1875388861081984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788510551.077025:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788510551.077033:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510551.077036:0:14477:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788510551.077042:0:14477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff929aaeb69800 00000020:00000080:2.0:1788510551.077045:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788510551.077052:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788510551.077054:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510551.077056:0:14477:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788510551.077058:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788510551.077060:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510551.077062:0:14477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788510551.077065:0:14477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff929aaeb69800 00000020:00000080:2.0:1788510551.077066:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788510551.077133:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788510551.077136:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510551.077138:0:14477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788510551.077140:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788510551.077142:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510551.077143:0:14477:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788510551.077147:0:14477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff929aaeb69800 00000020:00000080:2.0:1788510551.077149:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788510551.077184:0:14477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14477:1875388861082112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788510551.077214:0:14477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510551.080671:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861082112 00000100:00100000:3.0:1788510551.080685:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861082112 00000100:00100000:3.0:1788510551.080745:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788510551.080756:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82caa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14477:x1875388861082112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510551.083215:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82caa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14477:x1875388861082112:12345-0@lo:502:llog_process_th.0 Request processed in 2453us (5991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510551.083259:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788510551.084751:0:14477:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab50546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510551.084813:0:14477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14477:1875388861082112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788510551.084861:0:14477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788510551.084870:0:14477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510551.084872:0:14477:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788510551.084877:0:14477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788510551.085701:0:14433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788510551.085727:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788510551.085852:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510551.085866:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510551.085918:0:14433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788510551.085926:0:14433:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff929aaeb69800 10000000:01000000:0.0:1788510551.085929:0:14433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff929aaeb69800 10000000:01000000:0.0:1788510551.085933:0:14433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788510551.085939:0:14433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff929aaeb69800 from 1 10000000:01000000:0.0:1788510551.085943:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788510551.085986:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eaea00/0x3e734462ed6645b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510551.085996:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a90eaea00/0x3e734462ed6645b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510551.086008:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a90eaea00/0x3e734462ed6645b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510551.086030:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861082240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788510551.086101:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510551.086149:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc240 going to sleep for 11 seconds 00000100:00100000:3.0:1788510551.086706:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861082240 00000100:00100000:3.0:1788510551.086714:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861082240 00000100:00100000:3.0:1788510551.086903:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788510551.086913:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14433:x1875388861082240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788510551.086928:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510551.086942:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929ab4a68e00/0x3e734462ed66462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6645b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510551.086970:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929ab4a68e00/0x3e734462ed66462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6645b expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510551.086983:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929ab4a68e00/0x3e734462ed66462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6645b expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510551.086992:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68e00, rc 0) 00000100:00100000:3.0:1788510551.087160:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14433:x1875388861082240:12345-0@lo:101:mount.lustre.0 Request processed in 248us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510551.087168:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788510551.087896:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861082240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788510551.087916:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a90eaea00/0x3e734462ed6645b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66462 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510551.087927:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a90eaea00/0x3e734462ed6645b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed66462 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510551.088005:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861082368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788510551.089172:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510551.089219:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab5054000 going to sleep for 11 seconds 00000100:00100000:2.0:1788510551.089262:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861082368 00000100:00100000:2.0:1788510551.089269:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861082368 00000100:00100000:2.0:1788510551.089316:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788510551.089325:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14433:x1875388861082368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788510551.091599:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14433:x1875388861082368:12345-0@lo:501:mount.lustre.0 Request processed in 1689us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510551.091834:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788510551.091931:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861082368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788510551.091993:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861082496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788510551.092856:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510551.094906:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab5054000 going to sleep for 11 seconds 00000100:00100000:3.0:1788510551.101781:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861082496 00000100:00100000:3.0:1788510551.101798:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861082496 00000100:00100000:3.0:1788510551.107893:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788510551.107920:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14433:x1875388861082496:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788510551.108180:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14433:x1875388861082496:12345-0@lo:503:mount.lustre.0 Request processed in 266us (15324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510551.108189:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788510551.108411:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861082496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788510551.117701:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14482:1875388861082624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510551.118838:0:14482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510551.118900:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861082624 00000100:00100000:3.0:1788510551.118911:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861082624 00000100:00100000:3.0:1788510551.118970:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788510551.118980:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14482:x1875388861082624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510551.119352:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14482:x1875388861082624:12345-0@lo:502:llog_process_th.0 Request processed in 372us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510551.119362:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788510551.119427:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8560bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510551.119456:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14482:1875388861082624:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788510551.119564:0:14482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788510551.119584:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff929ab4e84d40) 00000020:00000080:3.0:1788510551.119608:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788510551.119719:0:14482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff929aaeb69800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788510551.119724:0:14482:0:(tgt_mount.c:187:server_put_mount()) put mount ffff929aaeb69800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788510551.119727:0:14482:0:(obd_mount.c:710:lustre_put_lsi()) put ffff929aaeb69800 4 00010000:00080000:3.0:1788510551.119765:0:14482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff929ab4e95000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.104@tcp at head 00010000:00010000:3.0:1788510551.128585:0:14482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788510551.129344:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788510551.129394:0:14482:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788510551.129411:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e734462ed66470 00000100:00080000:3.0:1788510551.129423:0:14482:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788510551.129444:0:14482:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff929ab4e95000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:3.0:1788510551.129489:0:14482:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929aaf0dca80 x1875388861082752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788510551.129525:0:14482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788510551.129784:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875388861082752:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788510551.129866:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510551.130264:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861082752 00000100:00100000:3.0:1788510551.130274:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861082752 00000100:00100000:3.0:1788510551.130322:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788510551.130331:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3287:x1875388861082752:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788510551.130392:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3287:x1875388861082752:12345-0@lo:38:llog_process_th.0 Request processed in 60us (526us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788510551.130399:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510551.130493:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788510551.130502:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929ab4e95000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788510551.130507:0:3287:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788510551.130523:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875388861082752:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788510551.131950:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14482:1875388861082880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510551.132045:0:14482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510551.132086:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8560bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510551.133747:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861082880 00000100:00100000:3.0:1788510551.133766:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861082880 00000100:00100000:3.0:1788510551.133818:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788510551.133826:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14482:x1875388861082880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788510551.134172:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14482:x1875388861082880:12345-0@lo:502:llog_process_th.0 Request processed in 345us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510551.134181:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788510551.134281:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14482:1875388861082880:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788510551.134318:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788510551.136113:0:14433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788510551.136166:0:14433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788510551.136198:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eaea00/0x3e734462ed6645b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66462 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510551.136267:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a90eaea00/0x3e734462ed6645b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66462 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788510551.136328:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788510551.136330:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788510551.136332:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510551.136333:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510551.136334:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510551.136335:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510551.136337:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788510551.136339:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788510551.136340:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510551.136342:0:14433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788510551.136346:0:14433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788510551.136349:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788510551.136350:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788510551.136352:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510551.136352:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510551.136353:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510551.136354:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510551.136355:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788510551.136356:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788510551.136357:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510551.136358:0:14433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788510551.136392:0:14433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788510551.136418:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861083008:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788510551.136504:0:14433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510551.136924:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8560bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788510551.136952:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861083008 00000100:00100000:3.0:1788510551.136959:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861083008 00000100:00100000:3.0:1788510551.137002:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788510551.137011:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14433:x1875388861083008:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788510551.137217:0:14446:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788510551.137599:0:14446:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788510551.221506:0:14446:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788510551.221535:0:14446:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788510551.221825:0:14467:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788510551.221832:0:14467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788510551.221861:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.221882:0:14467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a90eaf600/0x3e734462ed66446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6643f expref: 12 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.221891:0:14467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.221935:0:14467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a90eaf600/0x3e734462ed66446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6643f expref: 12 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.221951:0:14467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a90eaf600/0x3e734462ed66446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6643f expref: 12 pid: 14443 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510551.221965:0:14467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1875388861083136:0@lo:104: 00000100:00100000:1.0:1788510551.222032:0:14467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510551.222085:0:14467:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a90db59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510551.222246:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861083136 00000100:00100000:0.0:1788510551.222255:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861083136 00000100:00100000:0.0:1788510551.222299:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510551.222308:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+3:14467:x1875388861083136:12345-0@lo:104: 00010000:00010000:0.0:1788510551.222334:0:14434:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510551.222395:0:14434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788510551.222401:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+3:14467:x1875388861083136:12345-0@lo:104: Request processed in 94us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510551.222408:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788510551.223285:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510551.223296:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223305:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76c00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510551.223310:0:14440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223318:0:14440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510551.223335:0:14440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510551.223341:0:14440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788510551.223379:0:14440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223386:0:14440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510551.223407:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223414:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929aaec76c00/0x3e734462ed6643f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66446 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223433:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510551.223434:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510551.223436:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510551.223467:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510551.223479:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861083264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510551.223525:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510551.223580:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861083264 00000100:00100000:1.0:1788510551.223586:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861083264 00010000:00010000:1.0:1788510551.223609:0:14436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a90eaf600/0x3e734462ed66446 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6643f expref: 13 pid: 14443 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510551.223636:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788510551.223645:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+13:3288:x1875388861083264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510551.223657:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510551.223669:0:14436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a90eaf600/0x3e734462ed66446 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6643f expref: 13 pid: 14443 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223680:0:14436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a90eaf600/0x3e734462ed66446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6643f expref: 13 pid: 14443 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223701:0:14436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223710:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788510551.223725:0:14436:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001894173s 00010000:00010000:1.0:1788510551.223730:0:14436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223736:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223744:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223750:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223755:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033a00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510551.223760:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223768:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223777:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510551.223798:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510551.223833:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+13:3288:x1875388861083264:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510551.223841:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788510551.223891:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861083264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788510551.225386:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a90eaf600/0x3e734462ed66446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6643f expref: 12 pid: 14443 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510551.225407:0:14467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1875388861083136:0@lo:104: 00010000:00010000:3.0:1788510551.225434:0:14467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510551.225445:0:14467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510551.225451:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510551.225457:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83033a00/0x3e734462ed66477 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510551.257586:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14433:x1875388861083008:12345-0@lo:253:mount.lustre.0 Request processed in 120560us (121067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510551.257608:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788510551.260697:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14433:1875388861083008:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788510551.260723:0:14433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788510551.260727:0:14433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788510551.260739:0:14433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788510551.260740:0:14433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510551.260741:0:14433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510551.260743:0:14433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510551.260744:0:14433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510551.260745:0:14433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788510551.260748:0:14433:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788510551.260750:0:14433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510551.260751:0:14433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788510551.260769:0:14433:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788510551.272126:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788510551.272309:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788510551.272563:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788510551.272690:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788510551.272914:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788510551.273039:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788510551.291128:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788510551.291401:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788510551.291680:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788510551.293405:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788510551.298312:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788510551.304383:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788510551.389668:0:14433:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788510551.390279:0:14433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788510551.391041:0:14488:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788510551.391046:0:14488:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788510551.391310:0:14489:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788510551.391378:0:14489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788510551.398513:0:14489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788510551.398590:0:14489:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788510551.398595:0:14489:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788510551.399439:0:14433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788510551.399599:0:14433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788510551.400299:0:14433:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788510551.400310:0:14433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788510551.400454:0:14433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788510551.402699:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788510551.403397:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788510551.403437:0:14433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788510551.409583:0:14433:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1788510551.414413:0:14433:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788510551.425809:0:14433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788510551.459561:0:14433:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788510551.459599:0:14433:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc1681917988 00100000:10000000:0.0:1788510551.459606:0:14433:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788510551.460603:0:14433:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788510551.460622:0:14433:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788510551.460640:0:14433:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788510551.460666:0:14433:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788510551.818467:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788510552.133785:0:14483:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788510552.133794:0:14483:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788510552.134142:0:14483:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788510552.134149:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1788510552.648300:0:14448:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788510552.648309:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff929aaeb69800 from 6 10000000:01000000:2.0:1788510552.648314:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788510552.648361:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510552.648374:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510552.648387:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510552.648416:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861083392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788510552.648524:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510552.648601:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8901e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510552.650399:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861083392 00000100:00100000:0.0:1788510552.650420:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861083392 00000100:00100000:0.0:1788510552.650497:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788510552.650510:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14448:x1875388861083392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510552.650533:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510552.650560:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eaf400/0x3e734462ed66485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6647e expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510552.650597:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eaf400/0x3e734462ed66485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6647e expref: 12 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510552.650611:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eaf400/0x3e734462ed66485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6647e expref: 12 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510552.650621:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf400, rc 0) 00000100:00100000:0.0:1788510552.650720:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14448:x1875388861083392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (2196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510552.650727:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788510552.651427:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861083392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510552.651453:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510552.651465:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510552.651549:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861083520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788510552.651605:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510552.651664:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8901e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510552.651897:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861083520 00000100:00100000:3.0:1788510552.651903:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861083520 00000100:00100000:3.0:1788510552.651952:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788510552.651962:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14448:x1875388861083520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788510552.651984:0:14446:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788510552.652002:0:14446:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788510552.652006:0:14446:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788510552.652116:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14448:x1875388861083520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 155us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510552.652125:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788510552.652207:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861083520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788510552.652282:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788510552.652354:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510552.652365:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510552.846998:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788510553.157692:0:14483:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788510553.157705:0:14483:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788510553.163189:0:14483:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788510553.164506:0:14483:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788510553.164548:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:3.0:1788510553.860498:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510554.884494:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510555.908765:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788510556.357824:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788510556.357832:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788510556.357835:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788510556.357838:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788510556.357840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788510556.357844:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788510556.357848:0:37:0:(import.c:65:import_set_state_nolock()) ffff929ab4e95000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788510556.357861:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff929ab4e95000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:1.0:1788510556.357884:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9299836c5500 x1875388861083776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788510556.357940:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875388861083776:0@lo:38:kworker.0 00000100:00100000:1.0:1788510556.358010:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510556.358137:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861083776 00000100:00100000:1.0:1788510556.358147:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861083776 00000100:00100000:1.0:1788510556.358196:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510556.358202:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3287:x1875388861083776:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788510556.358263:0:14453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:1.0:1788510556.358302:0:14453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e734462ed6648c 00000004:00100000:1.0:1788510556.358319:0:14453:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788510556.358495:0:14453:0:(import.c:65:import_set_state_nolock()) ffff929a85673800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788510556.358545:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875388861083776:12345-0@lo:38:kworker.0 Request processed in 341us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510556.358553:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788510556.358597:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9299836c5500 x1875388861083776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788510566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788510556.358612:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788510556.358619:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788510556.358624:0:3287:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788510556.358626:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929ab4e95000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788510556.358632:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875388861083776:0@lo:38:kworker.0 00000100:00100000:2.0:1788510556.363938:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3290:1875388861083648:0@lo:400:kworker.0 00000100:00100000:2.0:1788510556.364044:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510556.364310:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861083648 00000100:00100000:1.0:1788510556.364320:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861083648 00000100:00100000:1.0:1788510556.364376:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788510556.364386:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:3290:x1875388861083648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510556.364469:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:3290:x1875388861083648:12345-0@lo:400:kworker.0 Request processed in 83us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510556.364477:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788510556.364789:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3290:1875388861083648:0@lo:400:kworker.0 00010000:00010000:3.0:1788510556.933978:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788510557.278188:0:14733:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788510557.977897:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510558.980448:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510560.004457:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788510560.746395:0:14884:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2348d9a0 20000000:00000080:3.0:1788510560.746418:0:14884:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff929ab6217c00 uarg=0000000000000000 20000000:01000000:3.0:1788510560.746453:0:14884:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788510560.746460:0:14884:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788510560.746472:0:14884:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788510560.753425:0:14885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788510560.753604:0:14884:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788510560.764390:0:14884:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788510560.764486:0:14884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510560.764512:0:14884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a90eaf800/0x3e734462ed66454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6644d expref: 11 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510560.764521:0:14884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510560.764580:0:14884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a90eaf800/0x3e734462ed66454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6644d expref: 11 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510560.764597:0:14884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a90eaf800/0x3e734462ed66454 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6644d expref: 11 pid: 14443 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510560.764614:0:14884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14884:1875388861083904:0@lo:104: 00000100:00100000:3.0:1788510560.764699:0:14884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510560.764774:0:14884:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8577b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788510560.764815:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861083904 00000100:00100000:2.0:1788510560.764826:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861083904 00000100:00100000:2.0:1788510560.764887:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788510560.764898:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+3:14884:x1875388861083904:12345-0@lo:104: 00010000:00010000:2.0:1788510560.764912:0:14435:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510560.764994:0:14435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788510560.765001:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+3:14884:x1875388861083904:12345-0@lo:104: Request processed in 105us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510560.765008:0:14884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14884:1875388861083904:0@lo:104: 00000100:00100000:2.0:1788510560.765012:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788510560.765033:0:14884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765103:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510560.765110:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765131:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76a00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510560.765135:0:14440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765143:0:14440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510560.765150:0:14440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510560.765156:0:14440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788510560.765195:0:14440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765202:0:14440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510560.765251:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765258:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929aaec76a00/0x3e734462ed6644d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66454 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765276:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510560.765277:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510560.765279:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510560.765330:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3291:1875388861084032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788510560.765371:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510560.765475:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861084032 00000100:00100000:1.0:1788510560.765480:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861084032 00010000:00010000:1.0:1788510560.765502:0:14436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a90eaf800/0x3e734462ed66454 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6644d expref: 12 pid: 14443 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510560.765533:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510560.765548:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:3291:x1875388861084032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510560.765561:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510560.765566:0:14436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a90eaf800/0x3e734462ed66454 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6644d expref: 12 pid: 14443 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765579:0:14436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a90eaf800/0x3e734462ed66454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6644d expref: 12 pid: 14443 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765595:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a90eaf800/0x3e734462ed66454 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6644d expref: 12 pid: 14443 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765609:0:14436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765618:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765632:0:14436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765639:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765647:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765655:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765660:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69400 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510560.765664:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765679:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765693:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510560.765704:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788510560.765843:0:14884:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510560.765851:0:14884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510560.765868:0:14884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929ab4a69400/0x3e734462ed66493 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510560.766877:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:3291:x1875388861084032:12345-0@lo:103:ldlm_bl.0 Request processed in 1324us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510560.766889:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788510560.766922:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3291:1875388861084032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788510561.028517:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510561.476729:0:3287:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788510551/real 1788510551] req@ffff9299836c5c00 x1875388861081088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788510561 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510561.476759:0:3287:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9299836c5c00 x1875388861081088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788510561 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510561.476795:0:3287:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788510551/real 1788510551] req@ffff9299836c7100 x1875388861080960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788510561 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510561.476808:0:3287:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9299836c7100 x1875388861080960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788510561 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788510561.476826:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a84ec9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788510561.476834:0:3287:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788510561.476838:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861081088:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788510561.476843:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a82cec000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788510561.476847:0:3287:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788510561.476849:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861080960:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788510561.476991:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788510561.476996:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788510561.476998:0:37:0:(import.c:65:import_set_state_nolock()) ffff929a82cec000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788510561.477003:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 408 00000100:00100000:1.0:1788510561.477005:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861084160:0@lo:400:kworker.0 00000100:00080000:0.0:1788510561.477008:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788510561.477014:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff929a82cec000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:0.0:1788510561.477034:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929abb1e5880 x1875388861084288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788510561.477057:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788510561.477060:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788510561.477061:0:37:0:(import.c:65:import_set_state_nolock()) ffff929a84ec9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788510561.477064:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 408 00000100:00080000:0.0:1788510561.477067:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1788510561.477069:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788510561.477070:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff929a84ec9000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:0.0:1788510561.477082:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929abb1e5500 x1875388861084416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788510561.477114:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861084160 00000100:00100000:0.0:1788510561.477121:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861084160 00000100:00100000:0.0:1788510561.477167:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788510561.477176:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:3288:x1875388861084160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510561.477244:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:3288:x1875388861084160:12345-0@lo:400:kworker.0 Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510561.477252:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788510561.477286:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861084288:0@lo:8:kworker.0 00000400:00000100:0.0:1788510561.477305:0:3287:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875388861084288 offset 0 length 520: 4 00000100:00100000:0.0:1788510561.477323:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861084416:0@lo:8:kworker.0 00000100:00100000:1.0:1788510561.477327:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861084160:0@lo:400:kworker.0 00000400:00000100:0.0:1788510561.477336:0:3287:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875388861084416 offset 0 length 520: 4 00000100:00100000:1.0:1788510561.477337:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510561.477343:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861084544:0@lo:400:kworker.0 00000100:00100000:1.0:1788510561.477385:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510561.477449:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861084544 00000100:00100000:0.0:1788510561.477453:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861084544 00000100:00100000:0.0:1788510561.477532:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510561.477539:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861084544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510561.477594:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861084544:12345-0@lo:400:kworker.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510561.477607:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788510561.477636:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff929abb1e4a80 x1875388861084544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510561.477648:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861084544:0@lo:400:kworker.0 00010000:00010000:1.0:1788510562.052800:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788510562.310809:0:14448:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788510562.310832:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929aaeb69800 from 10 10000000:01000000:2.0:1788510562.310837:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788510562.310888:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510562.310901:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510562.310913:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510562.310958:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861084672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788510562.311034:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510562.311085:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8687b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510562.311168:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861084672 00000100:00100000:0.0:1788510562.311178:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861084672 00000100:00100000:0.0:1788510562.311272:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788510562.311284:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+11:14448:x1875388861084672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510562.311299:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510562.311315:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eae000/0x3e734462ed664a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6649a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510562.311342:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eae000/0x3e734462ed664a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6649a expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510562.311353:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eae000/0x3e734462ed664a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6649a expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510562.311363:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae000, rc 0) 00000100:00100000:0.0:1788510562.311404:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14448:x1875388861084672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510562.311411:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788510562.311461:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861084672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510562.311477:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510562.311486:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510562.311563:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861084800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510562.311595:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510562.311608:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82f9aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788510562.311620:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861084800 00000100:00100000:0.0:1788510562.311623:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861084800 00000100:00100000:0.0:1788510562.311642:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788510562.311648:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14448:x1875388861084800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510562.311918:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14448:x1875388861084800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510562.311937:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788510562.311966:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861084800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510562.312001:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861084928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510562.312034:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510562.312045:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82f9aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788510562.312054:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861084928 00000100:00100000:0.0:1788510562.312057:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861084928 00000100:00100000:0.0:1788510562.312074:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788510562.312079:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14448:x1875388861084928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510562.312204:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:14448:x1875388861084928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510562.312212:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788510562.312274:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861084928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788510562.313038:0:14951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788510562.313094:0:14448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788510562.313105:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788510562.313113:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510562.313123:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510563.080815:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788510563.408774:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788510564.103530:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510565.124626:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788510565.842144:0:15133:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788510565.842148:0:15133:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788510565.842442:0:15133:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff929981eab000 00000020:01000004:0.0:1788510565.842457:0:15133:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788510565.842467:0:15133:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788510565.842545:0:15133:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff929981850000) 00000020:00000080:0.0:1788510565.842562:0:15133:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788510565.867790:0:15133:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788510565.868077:0:15133:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788510565.868861:0:15133:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788510565.873037:0:15133:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788510565.874278:0:15133:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788510565.876887:0:15133:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 405: rc = 0 00100000:10000000:2.0:1788510565.878909:0:15133:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 405: rc = 0 00100000:10000000:2.0:1788510565.880597:0:15133:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 405: rc = 0 00100000:10000000:2.0:1788510565.884356:0:15133:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:3.0:1788510565.893871:0:15133:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 642: rc = 0 00100000:10000000:3.0:1788510565.894305:0:15133:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:3.0:1788510565.899279:0:15133:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 642: rc = 0 00100000:10000000:3.0:1788510565.901713:0:15133:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:3.0:1788510565.904145:0:15133:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 642: rc = 0 00000020:00000080:3.0:1788510565.908745:0:15133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788510565.908766:0:15133:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788510565.908783:0:15133:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e734462ed664af 00000020:01000004:3.0:1788510565.908794:0:15133:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788510565.908819:0:15133:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788510565.908823:0:15133:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788510565.908832:0:15133:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788510565.908837:0:15133:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788510565.908857:0:15133:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff929a84fb8000) 00000020:00000080:3.0:1788510565.908881:0:15133:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788510565.911067:0:15133:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788510565.911266:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788510565.911274:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788510565.915324:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788510565.915341:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788510565.916739:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788510565.916750:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788510565.931049:0:15133:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788510565.931600:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788510565.931608:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788510565.936053:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788510565.936067:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788510565.968154:0:15133:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788510565.968539:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788510565.968547:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788510565.970846:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788510565.970880:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788510565.971889:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788510565.971897:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788510565.974504:0:15133:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788510565.974740:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788510565.974748:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788510565.975330:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788510565.975335:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788510566.025160:0:15133:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788510566.025434:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788510566.025442:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788510566.031335:0:15133:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788510566.031354:0:15133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788510566.033172:0:15133:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788510566.033202:0:15133:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788510566.033209:0:15133:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788510566.060853:0:15133:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788510566.064098:0:15133:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.104@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788510566.064103:0:15133:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788510566.064105:0:15133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788510566.064107:0:15133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510566.064108:0:15133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510566.064109:0:15133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510566.064111:0:15133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510566.064112:0:15133:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788510566.064114:0:15133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510566.064116:0:15133:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788510566.064119:0:15133:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788510566.064122:0:15133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788510566.064123:0:15133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788510566.064124:0:15133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510566.064125:0:15133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510566.064127:0:15133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510566.064128:0:15133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510566.064129:0:15133:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788510566.064130:0:15133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510566.064131:0:15133:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788510566.064158:0:15133:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788510566.064180:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085056:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788510566.064327:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510566.064382:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7c70b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788510566.064477:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861085056 00000100:00100000:0.0:1788510566.064487:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861085056 00000100:00100000:0.0:1788510566.064551:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788510566.064562:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:15133:x1875388861085056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788510566.064614:0:14444:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788510566.064618:0:14444:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788510566.064623:0:14444:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788510566.083119:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:15133:x1875388861085056:12345-0@lo:253:mount.lustre.0 Request processed in 18550us (18783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510566.083133:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788510566.083278:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085056:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788510566.083295:0:15133:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788510566.083298:0:15133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788510566.083300:0:15133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788510566.083301:0:15133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510566.083302:0:15133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510566.083303:0:15133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510566.083305:0:15133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510566.083306:0:15133:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788510566.083308:0:15133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510566.083309:0:15133:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788510566.083332:0:15133:0:(tgt_mount.c:101:server_register_mount()) register mount ffff929981eab000 from lustre-OST0000 10000000:01000000:2.0:1788510566.083358:0:15133:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788510566.083373:0:15133:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788510566.083380:0:15133:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff929ab4e819c0 local copy 00010000:00010000:2.0:1788510566.083391:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ac expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510566.083852:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788510566.083904:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510566.083942:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8577b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788510566.084009:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861085184 00000100:00100000:2.0:1788510566.084015:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861085184 00000100:00100000:2.0:1788510566.084054:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788510566.084062:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:15133:x1875388861085184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788510566.084204:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:15133:x1875388861085184:12345-0@lo:501:mount.lustre.0 Request processed in 142us (299us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788510566.084212:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788510566.084409:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085184:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788510566.084425:0:15133:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788510566.084592:0:15133:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788510566.084601:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ac expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.084612:0:15133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ac expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510566.084638:0:15133:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff929981eab000 10000000:01000000:3.0:1788510566.084643:0:15133:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788510566.084648:0:15133:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff929ab4e819c0 10000000:01000000:3.0:1788510566.084651:0:15133:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788510566.084654:0:15133:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff929ab4e819c0 from 1 10000000:01000000:3.0:1788510566.084657:0:15133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788510566.084682:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a68800/0x3e734462ed664bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.084691:0:15133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929ab4a68800/0x3e734462ed664bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.084700:0:15133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929ab4a68800/0x3e734462ed664bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510566.084713:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788510566.084742:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510566.084774:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8577b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788510566.084842:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861085312 00000100:00100000:0.0:1788510566.084847:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861085312 00000100:00100000:0.0:1788510566.084895:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788510566.084904:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+12:15133:x1875388861085312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788510566.084914:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510566.084928:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eae200/0x3e734462ed664c4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed664bd expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510566.084950:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eae200/0x3e734462ed664c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed664bd expref: 13 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510566.084960:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eae200/0x3e734462ed664c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed664bd expref: 13 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510566.084968:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae200, rc 0) 00000100:00100000:0.0:1788510566.085008:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+13:15133:x1875388861085312:12345-0@lo:101:mount.lustre.0 Request processed in 105us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510566.085014:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788510566.085268:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788510566.085282:0:15133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929ab4a68800/0x3e734462ed664bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664c4 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.085299:0:15133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929ab4a68800/0x3e734462ed664bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed664c4 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510566.085316:0:15133:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788510566.085323:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a68800/0x3e734462ed664bd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664c4 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.085329:0:15133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929ab4a68800/0x3e734462ed664bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664c4 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510566.085336:0:15133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788510566.085339:0:15133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788510566.085343:0:15133:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788510566.085345:0:15133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788510566.085360:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69400/0x3e734462ed664cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.085368:0:15133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929ab4a69400/0x3e734462ed664cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.085375:0:15133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929ab4a69400/0x3e734462ed664cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510566.085387:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788510566.085414:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510566.085440:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8577b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788510566.085494:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861085440 00000100:00100000:2.0:1788510566.085499:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861085440 00000100:00100000:2.0:1788510566.085532:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788510566.085539:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+13:15133:x1875388861085440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788510566.085546:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510566.085556:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929aaec76400/0x3e734462ed664d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed664cb expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510566.085583:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929aaec76400/0x3e734462ed664d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed664cb expref: 14 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510566.085592:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929aaec76400/0x3e734462ed664d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed664cb expref: 14 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510566.085600:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76400, rc 0) 00000100:00100000:2.0:1788510566.085629:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+14:15133:x1875388861085440:12345-0@lo:101:mount.lustre.0 Request processed in 91us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510566.085645:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788510566.085929:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788510566.085942:0:15133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929ab4a69400/0x3e734462ed664cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664d2 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.085958:0:15133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929ab4a69400/0x3e734462ed664cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed664d2 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788510566.086834:0:15133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788510566.087897:0:15133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788510566.088137:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788510566.088182:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788510566.088218:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788510566.090193:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788510566.090527:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788510566.090711:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788510566.090818:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788510566.090826:0:15133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788510566.091366:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788510566.091432:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510566.091526:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8577b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788510566.094027:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861085568 00000100:00100000:2.0:1788510566.094043:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861085568 00000100:00100000:3.0:1788510566.095925:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788510566.095940:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+14:15133:x1875388861085568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788510566.096477:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+14:15133:x1875388861085568:12345-0@lo:501:mount.lustre.0 Request processed in 540us (5043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510566.096486:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788510566.096599:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788510566.096650:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085696:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788510566.096695:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510566.104331:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85d82540 going to sleep for 11 seconds 00000100:00100000:2.0:1788510566.109019:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861085696 00000100:00100000:2.0:1788510566.109040:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861085696 00000100:00100000:2.0:1788510566.109118:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788510566.109128:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+14:15133:x1875388861085696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788510566.110098:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+14:15133:x1875388861085696:12345-0@lo:503:mount.lustre.0 Request processed in 967us (13398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510566.110112:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788510566.110460:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085696:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788510566.112728:0:15133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788510566.112832:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788510566.113162:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510566.113240:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7c70000 going to sleep for 11 seconds 00000100:00100000:0.0:1788510566.113438:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861085824 00000100:00100000:0.0:1788510566.113446:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861085824 00000100:00100000:0.0:1788510566.113485:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788510566.113516:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+14:15133:x1875388861085824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788510566.114110:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+14:15133:x1875388861085824:12345-0@lo:502:mount.lustre.0 Request processed in 595us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510566.114120:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788510566.115466:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788510566.117913:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788510566.118006:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788510566.118045:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788510566.118113:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788510566.118151:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788510566.118183:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788510566.118267:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788510566.118306:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788510566.118340:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788510566.118382:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788510566.118412:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788510566.118450:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788510566.118497:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085952:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788510566.118839:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510566.118916:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85d82d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788510566.119115:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861085952 00000100:00100000:2.0:1788510566.119123:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861085952 00000100:00100000:2.0:1788510566.119183:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788510566.119193:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+14:15133:x1875388861085952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788510566.119449:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+14:15133:x1875388861085952:12345-0@lo:502:mount.lustre.0 Request processed in 257us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510566.119456:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788510566.119685:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861085952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788510566.119778:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788510566.119791:0:15133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788510566.121412:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788510566.121425:0:15147:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788510566.121432:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510566.121434:0:15147:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788510566.121440:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788510566.121454:0:15147:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff929a84fbcd40) 00000020:00000080:3.0:1788510566.121476:0:15147:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788510566.121488:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788510566.121564:0:15147:0:(tgt_mount.c:153:server_get_mount()) get mount ffff929981eab000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788510566.121915:0:15147:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788510566.121928:0:15147:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e734462ed664e0 00010000:00010000:0.0:1788510566.128887:0:15147:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788510566.130915:0:15147:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788510566.138949:0:15147:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788510566.148771:0:15147:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788510566.148785:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510566.148792:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510566.148794:0:15147:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788510566.148804:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788510566.148815:0:15147:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788510566.148817:0:15147:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788510566.148819:0:15147:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788510566.148821:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788510566.148824:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510566.148826:0:15147:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788510566.148830:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510566.148833:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510566.148834:0:15147:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788510566.148838:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788510566.148840:0:15147:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788510566.148843:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510566.148845:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510566.148846:0:15147:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788510566.148849:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510566.148851:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510566.148852:0:15147:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788510566.148855:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788510566.148932:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510566.148936:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510566.148938:0:15147:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788510566.148942:0:15147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00010000:00010000:1.0:1788510566.151208:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788510566.154134:0:15133:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788510566.154186:0:15133:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788510566.154244:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69400/0x3e734462ed664cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664d2 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510566.154258:0:15133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929ab4a69400/0x3e734462ed664cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664d2 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510566.154267:0:15133:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929981eab000 from 1 10000000:01000000:0.0:1788510566.154270:0:15133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788510566.154307:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510566.154316:0:15133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510566.154328:0:15133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510566.154355:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788510566.154433:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510566.154471:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85d82a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788510566.157188:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861086080 00000100:00100000:1.0:1788510566.157204:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861086080 00000100:00100000:1.0:1788510566.157285:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788510566.157296:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+14:15133:x1875388861086080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788510566.157314:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510566.157333:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a83032a00/0x3e734462ed664ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed664e7 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.157363:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83032a00/0x3e734462ed664ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed664e7 expref: 15 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.157395:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a83032a00/0x3e734462ed664ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed664e7 expref: 15 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.157405:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032a00, rc 0) 00000100:00100000:1.0:1788510566.157483:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:15133:x1875388861086080:12345-0@lo:101:mount.lustre.0 Request processed in 189us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510566.157490:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788510566.158155:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788510566.158177:0:15133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510566.158189:0:15133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788510566.158765:0:15133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788510566.159067:0:15133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788510566.159330:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788510566.159387:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788510566.159452:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788510566.159459:0:15133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788510566.159543:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788510566.159607:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510566.159642:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85d82a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510566.159934:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861086208 00000100:00100000:3.0:1788510566.159941:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861086208 00000100:00100000:3.0:1788510566.159985:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788510566.159994:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:15133:x1875388861086208:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788510566.160203:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:15133:x1875388861086208:12345-0@lo:501:mount.lustre.0 Request processed in 209us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510566.160211:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788510566.162105:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788510566.162153:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788510566.162213:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510566.162301:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85d82a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510566.162401:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861086336 00000100:00100000:3.0:1788510566.162408:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861086336 00000100:00100000:3.0:1788510566.162448:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788510566.162456:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:15133:x1875388861086336:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788510566.162644:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:15133:x1875388861086336:12345-0@lo:503:mount.lustre.0 Request processed in 188us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510566.162651:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788510566.162845:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086336:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788510566.163429:0:15133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788510566.163795:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788510566.163840:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510566.164021:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85d82a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788510566.166808:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861086464 00000100:00100000:3.0:1788510566.166823:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861086464 00000100:00100000:3.0:1788510566.166885:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788510566.166895:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:15133:x1875388861086464:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788510566.167174:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:15133:x1875388861086464:12345-0@lo:502:mount.lustre.0 Request processed in 280us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510566.167183:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788510566.167468:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788510566.168121:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788510566.168188:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788510566.168283:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788510566.168324:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788510566.168360:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788510566.168407:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788510566.168443:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788510566.168476:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788510566.168911:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086592:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788510566.168994:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510566.169077:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a84ebc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788510566.172392:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861086592 00000100:00100000:3.0:1788510566.172411:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861086592 00000100:00100000:3.0:1788510566.172487:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788510566.172698:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:15133:x1875388861086592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788510566.173019:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:15133:x1875388861086592:12345-0@lo:502:mount.lustre.0 Request processed in 523us (4025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510566.173028:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788510566.173135:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788510566.173521:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788510566.173537:0:15133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788510566.176814:0:15151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788510566.176830:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510566.176833:0:15151:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788510566.176842:0:15151:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff929981eab000 00000020:00000080:3.0:1788510566.176845:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788510566.176853:0:15151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788510566.176866:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510566.176868:0:15151:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788510566.176872:0:15151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788510566.176875:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510566.176876:0:15151:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788510566.176880:0:15151:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff929981eab000 00000020:00000080:3.0:1788510566.176881:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788510566.176989:0:15151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788510566.176994:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510566.176996:0:15151:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788510566.176998:0:15151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788510566.177001:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510566.177002:0:15151:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788510566.177006:0:15151:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff929981eab000 00000020:00000080:3.0:1788510566.177008:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788510566.185699:0:15151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788510566.185713:0:15151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510566.185715:0:15151:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788510566.185720:0:15151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788510566.185904:0:15133:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788510566.185934:0:15133:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788510566.185959:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.185983:0:15133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510566.186031:0:15133:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788510566.186034:0:15133:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff929981eab000 10000000:01000000:1.0:1788510566.186037:0:15133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff929981eab000 10000000:01000000:1.0:1788510566.186041:0:15133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788510566.186046:0:15133:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff929981eab000 from 1 10000000:01000000:1.0:1788510566.186048:0:15133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788510566.186085:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83033a00/0x3e734462ed664f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.186093:0:15133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a83033a00/0x3e734462ed664f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.186103:0:15133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a83033a00/0x3e734462ed664f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510566.186127:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788510566.186185:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510566.213440:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a84ebc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788510566.213496:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861086720 00000100:00100000:0.0:1788510566.213507:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861086720 00000100:00100000:0.0:1788510566.213568:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788510566.213580:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:15133:x1875388861086720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788510566.213598:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510566.213617:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eafc00/0x3e734462ed664fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed664f5 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510566.213647:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eafc00/0x3e734462ed664fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed664f5 expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510566.213659:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eafc00/0x3e734462ed664fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed664f5 expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510566.213681:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafc00, rc 0) 00000100:00100000:0.0:1788510566.213749:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15133:x1875388861086720:12345-0@lo:101:mount.lustre.0 Request processed in 170us (27563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510566.213756:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788510566.213848:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788510566.213883:0:15133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a83033a00/0x3e734462ed664f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664fc expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.213893:0:15133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a83033a00/0x3e734462ed664f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed664fc expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788510566.214572:0:15133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788510566.215076:0:15133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788510566.215371:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788510566.215418:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788510566.215452:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788510566.215502:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788510566.215538:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788510566.215583:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788510566.215619:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788510566.215655:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788510566.215708:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788510566.215746:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788510566.215781:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788510566.215824:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788510566.215891:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788510566.215928:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788510566.215977:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788510566.216015:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788510566.216049:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788510566.216098:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788510566.216131:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788510566.216164:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788510566.216215:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788510566.216299:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788510566.216336:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788510566.216383:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788510566.216420:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788510566.216454:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788510566.216528:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788510566.216566:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788510566.216664:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788510566.216678:0:15133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788510566.216774:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788510566.216845:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510566.228765:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a84ebc240 going to sleep for 11 seconds 00000100:00100000:3.0:1788510566.234836:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861086848 00000100:00100000:3.0:1788510566.234850:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861086848 00000100:00100000:3.0:1788510566.234928:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788510566.234941:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15133:x1875388861086848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788510566.235332:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15133:x1875388861086848:12345-0@lo:501:mount.lustre.0 Request processed in 393us (18486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510566.235341:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788510566.236553:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788510566.236635:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788510566.236706:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510566.236759:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a84ebc240 going to sleep for 11 seconds 00000100:00100000:2.0:1788510566.236839:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861086976 00000100:00100000:2.0:1788510566.236846:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861086976 00000100:00100000:2.0:1788510566.236910:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788510566.236920:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15133:x1875388861086976:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788510566.237138:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15133:x1875388861086976:12345-0@lo:503:mount.lustre.0 Request processed in 218us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510566.237152:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788510566.237267:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861086976:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788510566.237922:0:15133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788510566.237990:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861087104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788510566.238040:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510566.238066:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a84ebc240 going to sleep for 11 seconds 00000100:00100000:2.0:1788510566.238814:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861087104 00000100:00100000:2.0:1788510566.238823:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861087104 00000100:00100000:2.0:1788510566.238878:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788510566.238888:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15133:x1875388861087104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788510566.239134:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15133:x1875388861087104:12345-0@lo:502:mount.lustre.0 Request processed in 246us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510566.239142:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788510566.239262:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861087104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788510566.239546:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788510566.240963:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788510566.241020:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788510566.241088:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788510566.241128:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788510566.241176:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788510566.241215:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788510566.241287:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788510566.241344:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788510566.241383:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788510566.241418:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788510566.241504:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788510566.241544:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788510566.241599:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788510566.241664:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788510566.241705:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788510566.241738:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788510566.241786:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788510566.241825:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788510566.241878:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788510566.241929:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788510566.241968:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788510566.241999:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788510566.242063:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788510566.242102:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788510566.242140:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788510566.242188:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788510566.242270:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788510566.242307:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788510566.242357:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788510566.242393:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788510566.242425:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788510566.242457:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788510566.242507:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788510566.242544:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788510566.242594:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788510566.242632:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788510566.242666:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788510566.242710:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788510566.242742:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788510566.242797:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861087232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788510566.242905:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510566.242965:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88b33480 going to sleep for 11 seconds 00000100:00100000:0.0:1788510566.243278:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861087232 00000100:00100000:0.0:1788510566.243292:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861087232 00000100:00100000:0.0:1788510566.243366:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788510566.243378:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15133:x1875388861087232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788510566.243603:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15133:x1875388861087232:12345-0@lo:502:mount.lustre.0 Request processed in 226us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510566.243611:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788510566.246458:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861087232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788510566.246609:0:15133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788510566.246624:0:15133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788510566.257592:0:15156:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788510566.257612:0:15156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9299811a99c0) 00000020:00000080:2.0:1788510566.257635:0:15156:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788510566.257704:0:15156:0:(tgt_mount.c:153:server_get_mount()) get mount ffff929981eab000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788510566.257708:0:15156:0:(tgt_mount.c:187:server_put_mount()) put mount ffff929981eab000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788510566.257710:0:15156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff929981eab000 3 00010000:00080000:2.0:1788510566.257740:0:15156:0:(ldlm_lib.c:102:import_set_conn()) imp ffff929a8b809000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.104@tcp at head 00010000:00010000:2.0:1788510566.261924:0:15156:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788510566.262136:0:15156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788510566.262174:0:15156:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788510566.262204:0:15156:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3e734462ed6650a 00000100:00080000:2.0:1788510566.262216:0:15156:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788510566.263004:0:15156:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff929a8b809000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:2.0:1788510566.263050:0:15156:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929aaea7b800 x1875388861087360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788510566.263130:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1875388861087360:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788510566.263208:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788510566.263313:0:15156:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788510566.263463:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788510566.263468:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788510566.263471:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788510566.263473:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788510566.263539:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510566.263549:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861087488:0@lo:400:kworker.0 00000100:00100000:1.0:1788510566.263592:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510566.263631:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861087360 00000100:00100000:1.0:1788510566.263639:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861087360 00000100:00100000:1.0:1788510566.263683:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861087488 00000100:00100000:1.0:1788510566.263686:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861087488 00000100:00100000:1.0:1788510566.263713:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510566.263722:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861087488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510566.263772:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861087488:12345-0@lo:400:kworker.0 Request processed in 51us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510566.263779:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510566.263794:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788510566.263798:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3287:x1875388861087360:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788510566.263817:0:14452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:1.0:1788510566.263869:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e734462ed66511 00000004:00100000:1.0:1788510566.263885:0:14452:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788510566.263917:0:14452:0:(import.c:65:import_set_state_nolock()) ffff92998185d000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788510566.266881:0:15156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788510566.267196:0:15133:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788510566.267256:0:15133:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788510566.267279:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a83033a00/0x3e734462ed664f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664fc expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.267292:0:15133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a83033a00/0x3e734462ed664f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed664fc expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788510566.267354:0:15133:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788510566.267356:0:15133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788510566.267358:0:15133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510566.267359:0:15133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510566.267360:0:15133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510566.267362:0:15133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510566.267363:0:15133:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788510566.267366:0:15133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510566.267367:0:15133:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788510566.267372:0:15133:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788510566.267374:0:15133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788510566.267376:0:15133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788510566.267377:0:15133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510566.267378:0:15133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510566.267379:0:15133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510566.267380:0:15133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510566.267381:0:15133:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788510566.267382:0:15133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510566.267383:0:15133:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788510566.267412:0:15133:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788510566.267433:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861087616:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788510566.267496:0:15133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510566.267545:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788510566.268474:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861087616 00000100:00100000:0.0:1788510566.268483:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861087616 00000100:00100000:0.0:1788510566.268541:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788510566.268550:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15133:x1875388861087616:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788510566.268589:0:14443:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788510566.268604:0:14443:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788510566.273296:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875388861087360:12345-0@lo:38:llog_process_th.0 Request processed in 9485us (10077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510566.273313:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788510566.273412:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9299836c5c00 x1875388861087488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510566.273429:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861087488:0@lo:400:kworker.0 00010000:00080000:0.0:1788510566.277667:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929aaea7b800 x1875388861087360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788510576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510566.277683:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788510566.277694:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788510566.277702:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788510566.277708:0:3287:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788510566.277719:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a8b809000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788510566.277729:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3287:1875388861087360:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788510566.315186:0:14443:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788510566.315215:0:14443:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788510566.315333:0:14467:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788510566.315338:0:14467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788510566.315366:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.315387:0:14467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a90eaf400/0x3e734462ed66485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6647e expref: 16 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.315397:0:14467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.315447:0:14467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a90eaf400/0x3e734462ed66485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6647e expref: 16 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.315463:0:14467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a90eaf400/0x3e734462ed66485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6647e expref: 16 pid: 14444 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510566.315495:0:14467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1875388861087744:0@lo:104: 00000100:00100000:3.0:1788510566.315586:0:14467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510566.315639:0:14467:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510566.315790:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861087744 00000100:00100000:2.0:1788510566.315803:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861087744 00000100:00100000:2.0:1788510566.315867:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510566.315879:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+3:14467:x1875388861087744:12345-0@lo:104: 00010000:00010000:2.0:1788510566.315897:0:14435:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510566.315963:0:14435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788510566.315969:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+3:14467:x1875388861087744:12345-0@lo:104: Request processed in 93us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510566.315975:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788510566.316092:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510566.316101:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.316109:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77c00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:3.0:1788510566.316113:0:14439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.316123:0:14439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788510566.316150:0:14439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510566.316156:0:14439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788510566.316198:0:14439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.316207:0:14439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788510566.316253:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.316262:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929aaec77c00/0x3e734462ed6647e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66485 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510566.316279:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510566.316281:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510566.316283:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510566.316290:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788510566.316303:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3290:1875388861087872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788510566.316337:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510566.316388:0:14467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1875388861087744:0@lo:104: 00010000:00010000:3.0:1788510566.316410:0:14467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510566.316911:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861087872 00000100:00100000:1.0:1788510566.316917:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861087872 00010000:00010000:1.0:1788510566.316947:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a90eaf400/0x3e734462ed66485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6647e expref: 17 pid: 14444 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510566.316982:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788510566.316991:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:3290:x1875388861087872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510566.317015:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510566.317021:0:14438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a90eaf400/0x3e734462ed66485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6647e expref: 17 pid: 14444 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.317031:0:14438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a90eaf400/0x3e734462ed66485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6647e expref: 17 pid: 14444 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.317045:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a90eaf400/0x3e734462ed66485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6647e expref: 17 pid: 14444 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.317061:0:14438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.317069:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788510566.317083:0:14438:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001894173s 00010000:00010000:1.0:1788510566.317087:0:14438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.317094:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.317100:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.317107:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.317113:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510566.317117:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.317132:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.317156:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510566.317166:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510566.317206:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:3290:x1875388861087872:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510566.317213:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788510566.317291:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3290:1875388861087872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788510566.317361:0:14467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510566.317369:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510566.317376:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929ab4a68000/0x3e734462ed66518 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510566.363323:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15133:1875388861087616:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788510566.363344:0:15133:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788510566.363347:0:15133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788510566.363349:0:15133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788510566.363363:0:15133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788510566.363365:0:15133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788510566.363366:0:15133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788510566.363367:0:15133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788510566.363368:0:15133:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788510566.363370:0:15133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788510566.363372:0:15133:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788510566.363389:0:15133:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788510566.364634:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:15133:x1875388861087616:12345-0@lo:253:mount.lustre.0 Request processed in 96077us (97129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510566.364648:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00080000:10000000:3.0:1788510566.380155:0:15133:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510566.380426:0:15133:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788510566.380595:0:15133:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510566.380744:0:15133:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788510566.382254:0:15133:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788510566.384429:0:15133:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788510566.385948:0:15133:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788510566.476762:0:15133:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788510566.476774:0:15133:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788510566.476818:0:15133:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788510566.476890:0:15133:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788510566.476908:0:15133:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788510566.477009:0:15133:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788510567.176467:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788510567.624925:0:14448:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788510567.624935:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff929aaeb69800 from 7 10000000:01000000:3.0:1788510567.624942:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788510567.625004:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510567.625017:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510567.625028:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510567.625054:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861088000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788510567.625144:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510567.625211:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a85cf8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510567.625777:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861088000 00000100:00100000:2.0:1788510567.625788:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861088000 00000100:00100000:2.0:1788510567.625851:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788510567.625861:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+15:14448:x1875388861088000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510567.625876:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510567.625891:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929aaec77e00/0x3e734462ed66526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6651f expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510567.625926:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929aaec77e00/0x3e734462ed66526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6651f expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510567.625937:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929aaec77e00/0x3e734462ed66526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6651f expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510567.625947:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77e00, rc 0) 00000100:00100000:2.0:1788510567.625992:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:14448:x1875388861088000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510567.625998:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788510567.626044:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861088000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788510567.626081:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510567.626090:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510567.626145:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861088128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788510567.626182:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510567.626197:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a854fc240 going to sleep for 11 seconds 00000100:00100000:2.0:1788510567.626213:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861088128 00000100:00100000:2.0:1788510567.626216:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861088128 00000100:00100000:2.0:1788510567.626261:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788510567.626269:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:14448:x1875388861088128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788510567.626283:0:14443:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788510567.626300:0:14443:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788510567.626304:0:14443:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788510567.626393:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:14448:x1875388861088128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510567.626401:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788510567.626432:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861088128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788510567.626485:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788510567.626492:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510567.626499:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510568.196654:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510569.223408:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510570.244654:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510571.269363:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788510571.719014:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788510571.719021:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788510571.719037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788510571.719041:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788510571.719124:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861088256:0@lo:400:kworker.0 00000100:00100000:3.0:1788510571.719216:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510571.719292:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788510571.719302:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861088384:0@lo:400:kworker.0 00000100:00100000:3.0:1788510571.719347:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510571.719455:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861088512:0@lo:400:kworker.0 00000100:00100000:3.0:1788510571.719497:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510571.720215:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861088256 00000100:00100000:3.0:1788510571.720249:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861088256 00000100:00100000:3.0:1788510571.720310:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788510571.720324:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:3288:x1875388861088256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510571.720784:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:3288:x1875388861088256:12345-0@lo:400:kworker.0 Request processed in 459us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510571.720799:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788510571.720865:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861088384 00000100:00100000:3.0:1788510571.720873:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861088384 00000100:00100000:3.0:1788510571.720913:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861088512 00000100:00100000:3.0:1788510571.720918:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861088512 00000100:00100000:3.0:1788510571.720965:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788510571.720971:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861088384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510571.721177:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861088384:12345-0@lo:400:kworker.0 Request processed in 203us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510571.721188:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788510571.721209:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788510571.721252:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861088512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510571.721292:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861088512:12345-0@lo:400:kworker.0 Request processed in 40us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510571.721302:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788510571.721689:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929aaf0dc380 x1875388861088512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510571.721709:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861088512:0@lo:400:kworker.0 00010000:00080000:3.0:1788510571.721805:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929aaf0dd880 x1875388861088384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510571.721818:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861088384:0@lo:400:kworker.0 00000100:00100000:3.0:1788510571.721836:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861088256:0@lo:400:kworker.0 00000100:00080000:1.0:1788510571.724077:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788510572.292382:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510573.316791:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788510573.641419:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788510574.343421:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788510574.390115:0:15502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788510575.375988:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510576.388698:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510576.516342:0:3287:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788510561/real 1788510561] req@ffff929abb1e5880 x1875388861084288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788510576 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510576.516379:0:3287:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff929abb1e5880 x1875388861084288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788510576 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510576.516390:0:3287:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788510561/real 1788510561] req@ffff929abb1e5500 x1875388861084416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788510576 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510576.516401:0:3287:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff929abb1e5500 x1875388861084416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788510576 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788510576.516421:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a82cec000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788510576.516445:0:3287:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788510576.516449:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861084288:0@lo:8:kworker.0 00000100:00080000:2.0:1788510576.516455:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a84ec9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788510576.516459:0:3287:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788510576.516462:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861084416:0@lo:8:kworker.0 00000100:00080000:1.0:1788510576.516670:0:15274:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788510576.516675:0:15274:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788510576.516687:0:15274:0:(import.c:65:import_set_state_nolock()) ffff929a82cec000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788510576.516693:0:15274:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1788510576.516698:0:15274:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788510576.516705:0:15274:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff929a82cec000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:1.0:1788510576.516727:0:15274:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9299836c5500 x1875388861088768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788510576.516753:0:15274:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788510576.516756:0:15274:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788510576.516758:0:15274:0:(import.c:65:import_set_state_nolock()) ffff929a84ec9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788510576.516761:0:15274:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1788510576.516763:0:15274:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788510576.516767:0:15274:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff929a84ec9000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:1.0:1788510576.516781:0:15274:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9299836c4380 x1875388861088896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788510576.516826:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788510576.516839:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3290:1875388861088640:0@lo:400:kworker.0 00000100:00100000:1.0:1788510576.516924:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510576.516980:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861089024:0@lo:400:kworker.0 00000100:00100000:1.0:1788510576.517008:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510576.517030:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510576.517035:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861089152:0@lo:400:kworker.0 00000100:00100000:1.0:1788510576.517061:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510576.517092:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861088640 00000100:00100000:1.0:1788510576.517099:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861088640 00000100:00100000:1.0:1788510576.517146:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788510576.517156:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:3290:x1875388861088640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510576.517201:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:3290:x1875388861088640:12345-0@lo:400:kworker.0 Request processed in 47us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510576.517208:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788510576.517262:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861089024 00000100:00100000:1.0:1788510576.517267:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861089024 00000100:00100000:1.0:1788510576.517300:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861089152 00000100:00100000:1.0:1788510576.517303:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861089152 00000100:00100000:1.0:1788510576.517507:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788510576.517515:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861089024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510576.517552:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861089024:12345-0@lo:400:kworker.0 Request processed in 38us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510576.517558:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788510576.517626:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788510576.517634:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861089152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510576.517664:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861089152:12345-0@lo:400:kworker.0 Request processed in 31us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510576.517670:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788510576.517709:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788510576.517738:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9299836c6a00 x1875388861089152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510576.517749:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861089152:0@lo:400:kworker.0 00010000:00080000:1.0:1788510576.517759:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9299836c4700 x1875388861089024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510576.517768:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861089024:0@lo:400:kworker.0 00000100:00100000:1.0:1788510576.517796:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3290:1875388861088640:0@lo:400:kworker.0 00000100:00100000:2.0:1788510576.517880:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861088768:0@lo:8:kworker.0 00000100:00100000:2.0:1788510576.517915:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510576.517947:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861088896:0@lo:8:kworker.0 00000100:00100000:2.0:1788510576.517971:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510576.518083:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861088768 00000100:00100000:1.0:1788510576.518088:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861088768 00000100:00100000:1.0:1788510576.518113:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861088896 00000100:00100000:1.0:1788510576.518116:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861088896 00000100:00100000:1.0:1788510576.518127:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788510576.518131:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3287:x1875388861088768:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788510576.518162:0:15134:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:1.0:1788510576.518187:0:15134:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e734462ed6652d 00002000:00100000:1.0:1788510576.518201:0:15134:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff929abae58800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788510576.518205:0:15134:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788510576.518207:0:15134:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788510576.518670:0:15134:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788510576.518704:0:15134:0:(import.c:65:import_set_state_nolock()) ffff929abae5b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788510576.518752:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1875388861088768:12345-0@lo:8:kworker.0 Request processed in 619us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510576.518759:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788510576.518776:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510576.518780:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3287:x1875388861088896:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788510576.518794:0:15134:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788510576.518836:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3287:x1875388861088896:12345-0@lo:8:kworker.0 Request processed in 53us (863us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788510576.518846:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788510576.519001:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9299836c5500 x1875388861088768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788510596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510576.519011:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788510576.519017:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788510576.519034:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788510576.519039:0:3287:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788510576.519041:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a82cec000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788510576.519066:0:3287:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788510576.519072:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861088768:0@lo:8:kworker.0 00000100:00080000:2.0:1788510576.519087:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a84ec9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788510576.519091:0:3287:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788510576.519093:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861088896:0@lo:8:kworker.0 00000004:00080000:2.0:1788510576.519146:0:14474:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788510576.519176:0:14474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14474:1875388861089408:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788510576.519252:0:14474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510576.519279:0:14474:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7d9c3c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788510576.519459:0:14473:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788510576.519773:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510576.519790:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861089280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510576.519850:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510576.521298:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861089408 00000100:00100000:2.0:1788510576.521314:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861089408 00000100:00100000:2.0:1788510576.521459:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510576.521468:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14474:x1875388861089408:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788510576.522627:0:14473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 434341401743ns, next at 0ns, rc = 0 00000100:00080000:1.0:1788510576.523006:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510576.523470:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861089280 00000100:00100000:0.0:1788510576.523485:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861089280 00000100:00100000:0.0:1788510576.523567:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510576.523577:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861089280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788510576.523614:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510576.523745:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861089280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (3893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510576.523756:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788510576.525279:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929aaea79c00 x1875388861089280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510576.525314:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861089280:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1788510576.537063:0:15136:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788510576.537077:0:15136:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788510576.537084:0:15136:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1788510576.568814:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.568832:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af0893a2/0x3e734462ed66534 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.568856:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.568864:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.568874:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af0893a2/0x3e734462ed66534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.568920:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af0893a2/0x3e734462ed66534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.568933:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af0893a2/0x3e734462ed66534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.568941:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af0893a2/0x3e734462ed66534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.568965:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510576.568979:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.568985:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af0893a2/0x3e734462ed66534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.568993:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76200 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.568998:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0893a2/0x3e734462ed66534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.569007:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0893a2/0x3e734462ed66534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.569029:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af0893a2/0x3e734462ed66534 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.569039:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af0893a2/0x3e734462ed66534 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.569083:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.569087:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.569091:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.573975:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.573988:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca1bbc7/0x3e734462ed6653b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574009:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.574013:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.574020:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca1bbc7/0x3e734462ed6653b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574036:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca1bbc7/0x3e734462ed6653b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574046:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eca1bbc7/0x3e734462ed6653b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574053:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eca1bbc7/0x3e734462ed6653b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574082:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510576.574106:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.574113:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eca1bbc7/0x3e734462ed6653b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574135:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77400 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.574140:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca1bbc7/0x3e734462ed6653b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574148:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca1bbc7/0x3e734462ed6653b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574164:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eca1bbc7/0x3e734462ed6653b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574172:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca1bbc7/0x3e734462ed6653b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574190:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.574192:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.574194:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.574922:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.574929:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf3c89a/0x3e734462ed66542 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574939:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.574943:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.574946:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf3c89a/0x3e734462ed66542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574956:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bf3c89a/0x3e734462ed66542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574970:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf3c89a/0x3e734462ed66542 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574978:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bf3c89a/0x3e734462ed66542 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.574997:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510576.575014:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.575018:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bf3c89a/0x3e734462ed66542 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575024:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.575028:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf3c89a/0x3e734462ed66542 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575036:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf3c89a/0x3e734462ed66542 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575048:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bf3c89a/0x3e734462ed66542 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575055:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bf3c89a/0x3e734462ed66542 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575070:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.575078:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.575080:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.575707:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.575722:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e1a184/0x3e734462ed66549 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575737:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.575743:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.575751:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009e1a184/0x3e734462ed66549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575770:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009e1a184/0x3e734462ed66549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575784:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e1a184/0x3e734462ed66549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575796:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009e1a184/0x3e734462ed66549 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575834:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510576.575861:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.575871:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009e1a184/0x3e734462ed66549 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575883:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.575888:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e1a184/0x3e734462ed66549 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575919:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e1a184/0x3e734462ed66549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575932:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009e1a184/0x3e734462ed66549 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575939:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009e1a184/0x3e734462ed66549 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.575955:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.575956:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.575959:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.586177:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.586194:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66550 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.586214:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.586240:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.586250:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.586269:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.586282:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.587418:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66550 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.587449:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510576.588001:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510576.588009:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66550 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.588018:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76c00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510576.588023:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66550 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.588041:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.588063:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66550 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.588071:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66550 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.588093:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510576.588095:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510576.588097:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.590458:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.590471:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc876e71/0x3e734462ed66557 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.590489:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.590494:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.590501:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc876e71/0x3e734462ed66557 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.590515:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc876e71/0x3e734462ed66557 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.590525:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc876e71/0x3e734462ed66557 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.590533:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc876e71/0x3e734462ed66557 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.590554:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788510576.591058:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.591065:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049b5ddc2/0x3e734462ed6655e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591080:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.591083:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.591087:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049b5ddc2/0x3e734462ed6655e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591096:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049b5ddc2/0x3e734462ed6655e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591104:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049b5ddc2/0x3e734462ed6655e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591111:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049b5ddc2/0x3e734462ed6655e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591131:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788510576.591145:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788510576.591150:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc876e71/0x3e734462ed66557 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591157:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76a00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.591162:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc876e71/0x3e734462ed66557 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591171:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc876e71/0x3e734462ed66557 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591200:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc876e71/0x3e734462ed66557 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591207:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc876e71/0x3e734462ed66557 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591249:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.591253:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049b5ddc2/0x3e734462ed6655e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591259:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77200 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.591261:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049b5ddc2/0x3e734462ed6655e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591268:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049b5ddc2/0x3e734462ed6655e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591277:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049b5ddc2/0x3e734462ed6655e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591283:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049b5ddc2/0x3e734462ed6655e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.591292:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.591294:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.591300:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510576.592745:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.597129:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.597145:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cbef2dc/0x3e734462ed66565 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.597163:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.597169:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.597176:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cbef2dc/0x3e734462ed66565 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.597191:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cbef2dc/0x3e734462ed66565 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.597201:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cbef2dc/0x3e734462ed66565 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.597210:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cbef2dc/0x3e734462ed66565 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.597474:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510576.597490:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.597496:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cbef2dc/0x3e734462ed66565 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.597505:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77c00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.597509:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cbef2dc/0x3e734462ed66565 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.597528:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cbef2dc/0x3e734462ed66565 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.597547:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cbef2dc/0x3e734462ed66565 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.597555:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cbef2dc/0x3e734462ed66565 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.597573:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.597574:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.597576:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.598178:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.598185:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f5fe0d6/0x3e734462ed6656c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598194:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.598198:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.598202:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f5fe0d6/0x3e734462ed6656c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598213:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f5fe0d6/0x3e734462ed6656c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598261:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f5fe0d6/0x3e734462ed6656c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598284:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f5fe0d6/0x3e734462ed6656c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598312:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510576.598357:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.598364:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f5fe0d6/0x3e734462ed6656c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598373:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.598380:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f5fe0d6/0x3e734462ed6656c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598391:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f5fe0d6/0x3e734462ed6656c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598410:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f5fe0d6/0x3e734462ed6656c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598419:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f5fe0d6/0x3e734462ed6656c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598443:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.598446:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.598448:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.598913:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.598926:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66573 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598935:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.598938:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.598942:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598952:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598960:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598968:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.598983:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510576.598993:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.598996:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599003:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.599007:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599015:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599035:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66573 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599043:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66573 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599058:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.599060:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.599062:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.599485:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.599492:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed6657a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599500:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.599503:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.599507:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed6657a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599516:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed6657a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599526:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed6657a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599532:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed6657a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599556:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510576.599565:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.599569:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed6657a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599576:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd400 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.599579:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed6657a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599587:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed6657a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599598:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed6657a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599606:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed6657a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.599621:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.599622:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.599624:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.600035:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.600041:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed66581 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.600049:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.600058:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.600062:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed66581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.600072:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed66581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.600079:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed66581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.600087:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed66581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.600101:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510576.600110:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.600114:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed66581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.600122:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.600126:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed66581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.600134:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed66581 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.600145:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed66581 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.600163:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed66581 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.600178:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.600179:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.600181:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.600642:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.600648:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed66588 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.600658:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.600661:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.600666:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed66588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.605970:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed66588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.605999:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed66588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.606008:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed66588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.606037:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510576.606059:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.606072:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed66588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.606080:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fca00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.606084:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed66588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.606093:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed66588 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.606112:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed66588 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.606120:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed66588 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.606140:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.606142:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.606143:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.609773:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.609791:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed6658f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.609813:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.609820:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.609829:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed6658f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.609869:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed6658f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.609883:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed6658f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.609894:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed6658f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.609926:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788510576.610814:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.610821:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed66596 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.610832:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.610835:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.610840:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed66596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.610851:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed66596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.610860:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed66596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.610889:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed66596 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.610914:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788510576.610931:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788510576.610937:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed6658f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.610944:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fce00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.610949:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed6658f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.610957:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed6658f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.610973:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed6658f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.610980:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed6658f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.610998:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.611001:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed66596 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.611019:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc200 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.611024:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed66596 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.611035:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed66596 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.611048:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed66596 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.611057:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed66596 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.611074:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.611075:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.611078:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510576.611509:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.623625:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.623646:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed6659d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.623666:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.623673:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.623696:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed6659d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.623718:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed6659d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.623745:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed6659d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.623754:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed6659d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.623780:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788510576.623801:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.623808:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed6659d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.623820:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.623826:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed6659d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.623837:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed6659d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.623861:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed6659d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.623869:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed6659d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.623898:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.623911:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.623913:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.625003:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.625012:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.625023:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.625026:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.625032:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.625044:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.625053:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.625060:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.625090:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788510576.630857:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.630876:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.630895:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.630899:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.630907:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.630937:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.630951:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.630959:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.630978:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788510576.630993:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788510576.630999:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.631006:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.631010:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.631019:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.631036:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.631045:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.631075:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788510576.631079:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.631085:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fcc00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510576.631088:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.631096:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.631105:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.631112:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.631124:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.631126:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.631128:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510576.631439:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.636062:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.636080:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed665b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.636098:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.636103:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.636119:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed665b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.636138:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed665b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.636150:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed665b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.636157:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed665b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.636180:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788510576.636633:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510576.636649:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed665b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.636662:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc200 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510576.636670:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed665b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.636706:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed665b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.636727:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed665b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.636737:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fc2ceac/0x3e734462ed665b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.636770:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510576.636772:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510576.636774:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.638263:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.638273:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed665b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.638289:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.638294:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.642581:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed665b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.642610:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed665b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.642625:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed665b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.642647:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed665b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.642690:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788510576.643715:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510576.643725:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed665b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.643736:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fce00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:0.0:1788510576.643741:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed665b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.643751:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed665b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.643782:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed665b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.643790:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e00a54d4/0x3e734462ed665b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.643816:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510576.643818:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510576.643820:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.643899:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.643905:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed665c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.643916:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.643921:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.643926:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed665c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.643936:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed665c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.643944:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed665c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.643950:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed665c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.646805:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788510576.647489:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.647498:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.647523:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.647528:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.647534:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.647549:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.647559:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.647567:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.648395:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788510576.648404:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed665c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.648411:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fca00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:0.0:1788510576.648415:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed665c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.648422:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed665c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.648440:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed665c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.648447:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000324fbaf7/0x3e734462ed665c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.648888:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510576.648897:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.648908:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:0.0:1788510576.648913:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.648922:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.648938:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.648948:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510576.648951:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510576.648954:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.656539:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788510576.656567:0:15136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.659893:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.664217:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.664274:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.666836:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.666851:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.666862:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.666915:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.666930:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.666938:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.667102:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788510576.668500:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510576.668517:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.668532:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fcc00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:0.0:1788510576.668539:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.668555:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.668603:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.668613:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000312c21ae/0x3e734462ed665ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.668648:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510576.668653:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510576.668655:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.673123:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.673139:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.673158:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.673163:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.673170:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.673186:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.673197:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.673215:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.673263:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510576.673863:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510576.673872:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.673883:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510576.673887:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.673898:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.673917:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.673936:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7292e6/0x3e734462ed665d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.673955:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510576.673957:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510576.673959:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788510576.679167:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788510576.681628:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.681641:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.681659:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.681664:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.681670:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.681696:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.681707:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.681715:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.681745:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510576.682493:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510576.682502:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.682512:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510576.682517:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.682527:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.682544:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.682552:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000692c09e1/0x3e734462ed665dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.682570:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510576.682572:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510576.682574:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.684617:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.684633:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed665e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.684656:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.684661:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.684668:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed665e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.684695:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed665e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.684706:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed665e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.684714:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed665e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.684740:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788510576.685162:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510576.685169:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed665e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.685178:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:0.0:1788510576.685183:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed665e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.685192:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed665e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.685207:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed665e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.685215:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df38f12/0x3e734462ed665e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510576.685264:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510576.685266:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510576.685268:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788510576.685308:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788510576.685314:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed665ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.687269:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788510576.687273:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510576.687281:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed665ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.687295:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed665ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.687455:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed665ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.687465:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed665ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.687488:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788510576.687775:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510576.687783:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed665ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.687792:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd400 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510576.687798:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed665ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.687807:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed665ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.687826:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed665ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.687845:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce057014/0x3e734462ed665ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.687867:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510576.687869:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510576.687871:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788510576.692130:0:15136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788510576.692146:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd2de5c5/0x3e734462ed665f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.692163:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788510576.692167:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788510576.692174:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd2de5c5/0x3e734462ed665f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.692188:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd2de5c5/0x3e734462ed665f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.692199:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd2de5c5/0x3e734462ed665f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.692207:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd2de5c5/0x3e734462ed665f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510576.692327:0:15136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788510576.692642:0:15136:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1788510576.692764:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14474:x1875388861089408:12345-0@lo:5:osp-pre-0-0.0 Request processed in 171292us (173540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510576.692778:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510576.693323:0:14474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14474:1875388861089408:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788510576.693340:0:14474:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788510576.693387:0:14474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14474:1875388861089536:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788510576.693422:0:14474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510576.693465:0:14474:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7d9c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510576.693847:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861089536 00000100:00100000:3.0:1788510576.693854:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861089536 00000100:00100000:3.0:1788510576.693889:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788510576.693897:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14474:x1875388861089536:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788510576.693933:0:15135:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1788510576.698462:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510576.698475:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd2de5c5/0x3e734462ed665f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.698489:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a68000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510576.698495:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd2de5c5/0x3e734462ed665f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.698507:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd2de5c5/0x3e734462ed665f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.698528:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd2de5c5/0x3e734462ed665f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510576.698536:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd2de5c5/0x3e734462ed665f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510576.698627:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.698629:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510576.698631:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510576.711883:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14474:x1875388861089536:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17977us (18451us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788510576.711898:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788510576.714017:0:14474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14474:1875388861089536:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788510576.714043:0:14474:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:2.0:1788510577.050697:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788510577.050726:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1788510577.412883:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510578.436418:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510579.460781:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510580.495357:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510581.510536:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510581.957412:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788510581.957446:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861089664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788510581.957517:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510581.957582:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861089664 00000100:00100000:0.0:1788510581.957601:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861089664 00000100:00100000:0.0:1788510581.957658:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788510581.957668:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861089664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788510581.957708:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510581.957754:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861089664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510581.957762:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788510581.957783:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510581.957827:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788510581.957856:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861089664:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788510581.964245:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788510581.964254:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788510581.964258:0:37:0:(import.c:65:import_set_state_nolock()) ffff929a84ec9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788510581.964269:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:3.0:1788510581.964276:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788510581.964283:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff929a84ec9000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:3.0:1788510581.964300:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861089792:0@lo:400:kworker.0 00000100:00100000:3.0:1788510581.964384:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510581.964665:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861089792 00000100:00100000:3.0:1788510581.964677:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861089792 00000100:00100000:3.0:1788510581.964739:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788510581.964750:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:3288:x1875388861089792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510581.964889:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:3288:x1875388861089792:12345-0@lo:400:kworker.0 Request processed in 140us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510581.964909:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788510581.964972:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861089792:0@lo:400:kworker.0 00000100:00100000:3.0:1788510581.966318:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929aaf0ddc00 x1875388861089920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788510581.966369:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875388861090048:0@lo:400:kworker.0 00000100:00100000:3.0:1788510581.966542:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510581.966639:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861090048 00000100:00100000:3.0:1788510581.966645:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861090048 00000100:00100000:3.0:1788510581.966690:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788510581.966699:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875388861090048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510581.966743:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875388861090048:12345-0@lo:400:kworker.0 Request processed in 44us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510581.966750:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788510581.966785:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929aaf0dd880 x1875388861090048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510581.966797:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875388861090048:0@lo:400:kworker.0 00000100:00100000:2.0:1788510581.967493:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861089920:0@lo:8:kworker.0 00000100:00100000:2.0:1788510581.967541:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510581.968607:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861089920 00000100:00100000:3.0:1788510581.968618:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861089920 00000100:00100000:3.0:1788510581.968660:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788510581.968668:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3287:x1875388861089920:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788510581.968687:0:15136:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788510581.984926:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861090176:0@lo:400:kworker.0 00000100:00100000:2.0:1788510581.986345:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510581.986579:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861090176 00000100:00100000:1.0:1788510581.986598:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861090176 00000100:00100000:1.0:1788510581.986669:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788510581.986681:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861090176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510581.986745:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861090176:12345-0@lo:400:kworker.0 Request processed in 67us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510581.986752:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788510581.987371:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788510581.988538:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929aaea78000 x1875388861090176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510581.988558:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861090176:0@lo:400:kworker.0 00000100:00100000:3.0:1788510582.017681:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3287:x1875388861089920:12345-0@lo:8:kworker.0 Request processed in 48996us (50123us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788510582.017699:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788510582.019133:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a84ec9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788510582.019145:0:3287:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788510582.019151:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861089920:0@lo:8:kworker.0 00000020:01000004:2.0:1788510582.522629:0:15855:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788510582.522634:0:15855:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788510582.522822:0:15855:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9299810a7800 00000020:01000004:2.0:1788510582.522845:0:15855:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788510582.522863:0:15855:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788510582.522879:0:15855:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9299811a8000) 00000020:00000080:2.0:1788510582.522898:0:15855:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1788510582.535151:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788510582.544018:0:15855:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788510582.544358:0:15855:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788510582.545115:0:15855:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788510582.545392:0:15855:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788510582.545635:0:15855:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788510582.545978:0:15855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 457: rc = 0 00100000:10000000:3.0:1788510582.546079:0:15855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 457: rc = 0 00100000:10000000:3.0:1788510582.546215:0:15855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 457: rc = 0 00100000:10000000:3.0:1788510582.552433:0:15855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 330: rc = 0 00100000:10000000:3.0:1788510582.553093:0:15855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 330: rc = 0 00100000:10000000:3.0:1788510582.553467:0:15855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 330: rc = 0 00100000:10000000:3.0:1788510582.553781:0:15855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 330: rc = 0 00100000:10000000:3.0:1788510582.554187:0:15855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 330: rc = 0 00100000:10000000:3.0:1788510582.554467:0:15855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 330: rc = 0 00000020:00000080:3.0:1788510582.563446:0:15855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788510582.563460:0:15855:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788510582.563471:0:15855:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e734462ed665ff 00000020:01000004:3.0:1788510582.563480:0:15855:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788510582.563501:0:15855:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788510582.563504:0:15855:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788510582.563510:0:15855:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788510582.563531:0:15855:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788510582.563534:0:15855:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788510582.591853:0:15855:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788510582.591897:0:15855:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.104@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788510582.591902:0:15855:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788510582.591904:0:15855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788510582.591905:0:15855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510582.591907:0:15855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510582.591908:0:15855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510582.591909:0:15855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510582.591910:0:15855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788510582.591912:0:15855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510582.591914:0:15855:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788510582.591919:0:15855:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788510582.591921:0:15855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788510582.591923:0:15855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788510582.591924:0:15855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510582.591925:0:15855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510582.591926:0:15855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510582.591927:0:15855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510582.591932:0:15855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788510582.591933:0:15855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510582.591934:0:15855:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788510582.591969:0:15855:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788510582.591987:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788510582.592072:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510582.592529:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c79c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510582.596337:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861090304 00000100:00100000:1.0:1788510582.596351:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861090304 00000100:00100000:1.0:1788510582.596507:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788510582.596518:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15855:x1875388861090304:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788510582.596582:0:14443:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788510582.596586:0:14443:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788510582.596591:0:14443:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788510582.613512:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15855:x1875388861090304:12345-0@lo:253:mount.lustre.0 Request processed in 16984us (21428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510582.613528:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788510582.613720:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788510582.613739:0:15855:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788510582.613743:0:15855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788510582.613745:0:15855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788510582.613746:0:15855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788510582.613748:0:15855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788510582.613749:0:15855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788510582.613750:0:15855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788510582.613751:0:15855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788510582.613753:0:15855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788510582.613755:0:15855:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788510582.613780:0:15855:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9299810a7800 from lustre-OST0001 10000000:01000000:2.0:1788510582.613817:0:15855:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788510582.613820:0:15855:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788510582.613829:0:15855:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff929ab4e819c0 local copy 00010000:00010000:2.0:1788510582.613852:0:15855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ac expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510582.614141:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788510582.614180:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510582.614260:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510582.614477:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861090432 00000100:00100000:3.0:1788510582.614485:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861090432 00000100:00100000:3.0:1788510582.614549:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788510582.614560:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15855:x1875388861090432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788510582.614877:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15855:x1875388861090432:12345-0@lo:501:mount.lustre.0 Request processed in 319us (696us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788510582.614887:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788510582.616163:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090432:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788510582.616194:0:15855:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788510582.616486:0:15855:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788510582.616499:0:15855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ac expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510582.616523:0:15855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929ab4a69a00/0x3e734462ed663a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed663ac expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510582.616557:0:15855:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9299810a7800 10000000:01000000:0.0:1788510582.616563:0:15855:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788510582.616570:0:15855:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788510582.616587:0:15855:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788510582.616593:0:15855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788510582.616597:0:15855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788510582.616642:0:15855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eae400/0x3e734462ed66606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510582.616651:0:15855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a90eae400/0x3e734462ed66606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510582.616662:0:15855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a90eae400/0x3e734462ed66606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510582.616683:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788510582.616758:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510582.616815:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a877b89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788510582.620053:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861090560 00000100:00100000:1.0:1788510582.620073:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861090560 00000100:00100000:1.0:1788510582.620271:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788510582.620283:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:15855:x1875388861090560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788510582.620301:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510582.620320:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a83033600/0x3e734462ed6660d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed66606 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.620350:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83033600/0x3e734462ed6660d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed66606 expref: 17 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.620361:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a83033600/0x3e734462ed6660d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed66606 expref: 17 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.620371:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033600, rc 0) 00000100:00100000:1.0:1788510582.620466:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:15855:x1875388861090560:12345-0@lo:101:mount.lustre.0 Request processed in 185us (3707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510582.620473:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788510582.620858:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788510582.620880:0:15855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a90eae400/0x3e734462ed66606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6660d expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510582.620892:0:15855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a90eae400/0x3e734462ed66606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed6660d expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788510582.627725:0:15855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788510582.643185:0:15855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788510582.643516:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788510582.643564:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788510582.643617:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788510582.643668:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788510582.643713:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788510582.643765:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788510582.643833:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788510582.643841:0:15855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788510582.643958:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788510582.644044:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510582.644094:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4c84240 going to sleep for 11 seconds 00000100:00100000:2.0:1788510582.644132:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861090688 00000100:00100000:2.0:1788510582.644141:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861090688 00000100:00100000:2.0:1788510582.644211:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788510582.644247:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:15855:x1875388861090688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788510582.644736:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:15855:x1875388861090688:12345-0@lo:501:mount.lustre.0 Request processed in 515us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510582.644745:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788510582.647557:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788510582.648586:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788510582.648853:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510582.648901:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4c84240 going to sleep for 11 seconds 00000100:00100000:0.0:1788510582.650427:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861090816 00000100:00100000:0.0:1788510582.650442:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861090816 00000100:00100000:0.0:1788510582.650511:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788510582.650521:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:15855:x1875388861090816:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788510582.650919:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:15855:x1875388861090816:12345-0@lo:503:mount.lustre.0 Request processed in 399us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510582.650927:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788510582.652132:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090816:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788510582.653177:0:15855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788510582.653316:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788510582.653408:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510582.653459:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a81377180 going to sleep for 11 seconds 00000100:00100000:3.0:1788510582.653519:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861090944 00000100:00100000:3.0:1788510582.653529:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861090944 00000100:00100000:3.0:1788510582.653599:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788510582.653609:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:15855:x1875388861090944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788510582.653892:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:15855:x1875388861090944:12345-0@lo:502:mount.lustre.0 Request processed in 283us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510582.653914:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788510582.655447:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861090944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788510582.655850:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788510582.655924:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788510582.656450:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788510582.656527:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788510582.656566:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788510582.658077:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788510582.658188:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788510582.659135:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788510582.659700:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788510582.659774:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788510582.659897:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510582.665119:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4c84240 going to sleep for 11 seconds 00000100:00100000:0.0:1788510582.665687:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861091072 00000100:00100000:0.0:1788510582.665698:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861091072 00000100:00100000:0.0:1788510582.665859:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788510582.665870:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:15855:x1875388861091072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788510582.666475:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:15855:x1875388861091072:12345-0@lo:502:mount.lustre.0 Request processed in 344us (6315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510582.666486:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788510582.669762:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788510582.670050:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788510582.670067:0:15855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788510582.671862:0:15856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788510582.671875:0:15856:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788510582.671884:0:15856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788510582.671887:0:15856:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788510582.671894:0:15856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788510582.671911:0:15856:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9299811ab380) 00000020:00000080:2.0:1788510582.671942:0:15856:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788510582.671948:0:15856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788510582.672044:0:15856:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9299810a7800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788510582.672052:0:15856:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788510582.672061:0:15856:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e734462ed6661b 00010000:00010000:3.0:1788510582.685405:0:15856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788510582.688406:0:15856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788510582.690497:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788510582.692556:0:15856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788510582.692585:0:15856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510582.692593:0:15856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510582.692595:0:15856:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788510582.692602:0:15856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510582.692606:0:15856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510582.692607:0:15856:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788510582.692611:0:15856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788510582.692612:0:15856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788510582.692615:0:15856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510582.692617:0:15856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510582.692619:0:15856:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788510582.692621:0:15856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788510582.692624:0:15856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510582.692625:0:15856:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788510582.692629:0:15856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788510582.692696:0:15856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788510582.692700:0:15856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788510582.692701:0:15856:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788510582.692705:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788510582.695217:0:15855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788510582.695320:0:15855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788510582.695346:0:15855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eae400/0x3e734462ed66606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6660d expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.695360:0:15855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a90eae400/0x3e734462ed66606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed6660d expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510582.695370:0:15855:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9299810a7800 from 1 10000000:01000000:2.0:1788510582.695372:0:15855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788510582.695420:0:15855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.695429:0:15855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.695451:0:15855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510582.695477:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788510582.695544:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510582.695809:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510582.695929:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861091200 00000100:00100000:0.0:1788510582.695939:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861091200 00000100:00100000:0.0:1788510582.695986:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788510582.695996:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:15855:x1875388861091200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788510582.696011:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510582.696028:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eafa00/0x3e734462ed66629 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed66622 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510582.696054:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eafa00/0x3e734462ed66629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed66622 expref: 18 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510582.696078:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eafa00/0x3e734462ed66629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed66622 expref: 18 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510582.696087:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafa00, rc 0) 00000100:00100000:0.0:1788510582.696134:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:15855:x1875388861091200:12345-0@lo:101:mount.lustre.0 Request processed in 138us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510582.696141:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788510582.698825:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788510582.698858:0:15855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.698872:0:15855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788510582.699485:0:15855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788510582.700176:0:15855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788510582.702011:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788510582.702080:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788510582.702160:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788510582.702169:0:15855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788510582.705969:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788510582.706039:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510582.706086:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510582.706199:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861091328 00000100:00100000:0.0:1788510582.706207:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861091328 00000100:00100000:0.0:1788510582.706284:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788510582.706294:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:15855:x1875388861091328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788510582.706570:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:15855:x1875388861091328:12345-0@lo:501:mount.lustre.0 Request processed in 275us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510582.707371:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788510582.707975:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788510582.708038:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788510582.708121:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510582.708158:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4b2ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510582.710906:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861091456 00000100:00100000:2.0:1788510582.710923:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861091456 00000100:00100000:2.0:1788510582.710992:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788510582.711001:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:15855:x1875388861091456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788510582.711556:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:15855:x1875388861091456:12345-0@lo:503:mount.lustre.0 Request processed in 555us (3433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510582.711648:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788510582.712521:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788510582.713777:0:15855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788510582.713867:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788510582.713945:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510582.713979:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4b2ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510582.714127:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861091584 00000100:00100000:2.0:1788510582.714135:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861091584 00000100:00100000:2.0:1788510582.714193:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788510582.714204:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:15855:x1875388861091584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788510582.714483:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:15855:x1875388861091584:12345-0@lo:502:mount.lustre.0 Request processed in 280us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510582.714491:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788510582.715145:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788510582.715694:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788510582.715754:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788510582.715802:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788510582.715839:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788510582.715872:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788510582.715919:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788510582.715951:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788510582.715981:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788510582.716024:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788510582.716098:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510582.716134:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4b2ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788510582.722346:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861091712 00000100:00100000:2.0:1788510582.722367:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861091712 00000100:00100000:2.0:1788510582.722451:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788510582.722464:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:15855:x1875388861091712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788510582.722812:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:15855:x1875388861091712:12345-0@lo:502:mount.lustre.0 Request processed in 350us (6712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510582.722821:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788510582.723438:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788510582.723649:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788510582.723670:0:15855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788510582.725096:0:15860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788510582.725109:0:15860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510582.725112:0:15860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788510582.725119:0:15860:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9299810a7800 00000020:00000080:3.0:1788510582.725121:0:15860:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788510582.725128:0:15860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788510582.725131:0:15860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510582.725132:0:15860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788510582.725135:0:15860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788510582.725137:0:15860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510582.725138:0:15860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788510582.725141:0:15860:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9299810a7800 00000020:00000080:3.0:1788510582.725144:0:15860:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788510582.725201:0:15860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788510582.725204:0:15860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510582.725206:0:15860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788510582.725218:0:15860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788510582.727532:0:15860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510582.727535:0:15860:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788510582.727549:0:15860:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9299810a7800 00000020:00000080:3.0:1788510582.727552:0:15860:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788510582.727729:0:15860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788510582.727734:0:15860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788510582.727735:0:15860:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788510582.727738:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788510582.728471:0:15855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788510582.728513:0:15855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788510582.728541:0:15855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.728554:0:15855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788510582.728631:0:15855:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788510582.728635:0:15855:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9299810a7800 10000000:01000000:2.0:1788510582.728639:0:15855:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9299810a7800 10000000:01000000:2.0:1788510582.728643:0:15855:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788510582.728662:0:15855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9299810a7800 from 1 10000000:01000000:2.0:1788510582.728666:0:15855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788510582.728712:0:15855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fca00/0x3e734462ed66630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.728721:0:15855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a813fca00/0x3e734462ed66630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.728733:0:15855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a813fca00/0x3e734462ed66630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510582.728760:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788510582.728849:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510582.728902:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c796c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510582.729106:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861091840 00000100:00100000:3.0:1788510582.729116:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861091840 00000100:00100000:3.0:1788510582.729182:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788510582.729193:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:15855:x1875388861091840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788510582.729208:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510582.729533:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929ab4a68200/0x3e734462ed66637 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed66630 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510582.729564:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929ab4a68200/0x3e734462ed66637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed66630 expref: 19 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510582.729587:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929ab4a68200/0x3e734462ed66637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed66630 expref: 19 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510582.729597:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68200, rc 0) 00000100:00100000:3.0:1788510582.729660:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:15855:x1875388861091840:12345-0@lo:101:mount.lustre.0 Request processed in 469us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510582.729668:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788510582.729845:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091840:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788510582.729862:0:15855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a813fca00/0x3e734462ed66630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66637 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.729870:0:15855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a813fca00/0x3e734462ed66630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed66637 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788510582.730747:0:15855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788510582.731194:0:15855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788510582.739841:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788510582.740005:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788510582.740045:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788510582.740114:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788510582.740155:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788510582.743925:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788510582.744064:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788510582.744107:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788510582.747698:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788510582.747853:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788510582.747892:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788510582.747973:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788510582.748011:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788510582.748041:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788510582.748091:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788510582.748158:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788510582.748204:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788510582.752820:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788510582.752956:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788510582.752995:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788510582.753096:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788510582.753138:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788510582.753174:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788510582.753291:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788510582.753332:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788510582.753368:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788510582.753419:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788510582.753458:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788510582.753496:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788510582.753545:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788510582.759997:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788510582.760114:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788510582.760156:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788510582.760516:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788510582.761072:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788510582.761155:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788510582.761204:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788510582.761341:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788510582.761349:0:15855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788510582.761460:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788510582.761525:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510582.762071:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89466540 going to sleep for 11 seconds 00000100:00100000:0.0:1788510582.763021:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861091968 00000100:00100000:0.0:1788510582.763035:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861091968 00000100:00100000:0.0:1788510582.763098:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788510582.763110:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:15855:x1875388861091968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788510582.763494:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:15855:x1875388861091968:12345-0@lo:501:mount.lustre.0 Request processed in 386us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510582.763502:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788510582.765458:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861091968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788510582.765528:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861092096:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788510582.765618:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510582.765663:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89466540 going to sleep for 11 seconds 00000100:00100000:2.0:1788510582.766460:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861092096 00000100:00100000:2.0:1788510582.766472:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861092096 00000100:00100000:2.0:1788510582.766533:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788510582.766544:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:15855:x1875388861092096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788510582.769073:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:15855:x1875388861092096:12345-0@lo:503:mount.lustre.0 Request processed in 2520us (3445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510582.769092:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788510582.769311:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861092096:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788510582.770483:0:15855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788510582.771718:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861092224:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788510582.771941:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510582.772000:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89466540 going to sleep for 11 seconds 00000100:00100000:0.0:1788510582.773733:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861092224 00000100:00100000:0.0:1788510582.773748:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861092224 00000100:00100000:0.0:1788510582.773812:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788510582.773821:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:15855:x1875388861092224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788510582.774538:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861092224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788510582.774947:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788510582.775011:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788510582.775051:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788510582.775103:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788510582.775141:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788510582.775252:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788510582.776662:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788510582.776706:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788510582.776776:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788510582.776823:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788510582.776858:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788510582.776903:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788510582.776941:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788510582.776973:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788510582.777029:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788510582.777065:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788510582.777096:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788510582.777141:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788510582.777172:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000100:00100000:0.0:1788510582.777528:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:15855:x1875388861092224:12345-0@lo:502:mount.lustre.0 Request processed in 3702us (5582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510582.777550:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000040:00080000:1.0:1788510582.786477:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788510582.786608:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788510582.786650:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788510582.786725:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788510582.786779:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788510582.786817:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788510582.786851:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788510582.786898:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788510582.786934:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788510582.786971:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788510582.787041:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788510582.787084:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788510582.787122:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788510582.787155:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788510582.793492:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788510582.793652:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788510582.793710:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788510582.793749:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788510582.793783:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788510582.793857:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788510582.793896:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788510582.793966:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861092352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788510582.794076:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510582.794137:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89466540 going to sleep for 11 seconds 00000100:00100000:2.0:1788510582.794517:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861092352 00000100:00100000:2.0:1788510582.794526:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861092352 00000100:00100000:2.0:1788510582.794593:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788510582.794605:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:15855:x1875388861092352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788510582.794903:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:15855:x1875388861092352:12345-0@lo:502:mount.lustre.0 Request processed in 300us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510582.794911:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788510582.798601:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861092352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788510582.798813:0:15855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788510582.798833:0:15855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788510582.807827:0:15865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788510582.807858:0:15865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff929982078000) 00000020:00000080:2.0:1788510582.807882:0:15865:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788510582.807965:0:15865:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9299810a7800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788510582.807969:0:15865:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9299810a7800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788510582.807972:0:15865:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9299810a7800 3 00010000:00080000:2.0:1788510582.808012:0:15865:0:(ldlm_lib.c:102:import_set_conn()) imp ffff929983669000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.104@tcp at head 00010000:00010000:2.0:1788510582.816517:0:15865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788510582.825269:0:15865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788510582.825314:0:15865:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788510582.825331:0:15865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3e734462ed66645 00000100:00080000:2.0:1788510582.825343:0:15865:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788510582.825349:0:15865:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff929983669000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:2.0:1788510582.825389:0:15865:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929aaea7a680 x1875388861092480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788510582.825416:0:15865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788510582.828055:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1875388861092480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788510582.828152:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788510582.828333:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788510582.828347:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788510582.828350:0:36:0:(import.c:65:import_set_state_nolock()) ffff929a84ec9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788510582.828356:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:3.0:1788510582.828362:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788510582.828368:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff929a84ec9000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:3.0:1788510582.828391:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff929aaf0dd500 x1875388861092736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788510582.828466:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861092480 00000100:00100000:3.0:1788510582.828473:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861092480 00000100:00100000:3.0:1788510582.828536:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788510582.828546:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3287:x1875388861092480:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788510582.828589:0:14453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:3.0:1788510582.828637:0:14453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e734462ed6664c 00000004:00100000:3.0:1788510582.828665:0:14453:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788510582.828715:0:14453:0:(import.c:65:import_set_state_nolock()) ffff929a98074800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788510582.828776:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875388861092480:12345-0@lo:38:llog_process_th.0 Request processed in 230us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510582.828784:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788510582.828818:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861092608:0@lo:400:kworker.0 00000100:00100000:3.0:1788510582.828856:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510582.828893:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861092736:0@lo:8:kworker.0 00000100:00100000:3.0:1788510582.828921:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788510582.828956:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929aaea7a680 x1875388861092480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788510592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510582.828967:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788510582.828994:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788510582.829004:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788510582.829009:0:3287:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788510582.829011:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929983669000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788510582.829016:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3287:1875388861092480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788510582.829046:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861092864:0@lo:400:kworker.0 00000100:00100000:3.0:1788510582.829075:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510582.829095:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788510582.829102:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861092992:0@lo:400:kworker.0 00000100:00100000:3.0:1788510582.829123:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510582.829150:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861092864 00000100:00100000:3.0:1788510582.829154:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861092864 00000100:00100000:3.0:1788510582.829179:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861092992 00000100:00100000:3.0:1788510582.829182:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861092992 00000100:00100000:3.0:1788510582.829194:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788510582.829200:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861092864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510582.829266:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861092864:12345-0@lo:400:kworker.0 Request processed in 65us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510582.829274:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788510582.829286:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788510582.829293:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861092992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510582.829319:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861092992:12345-0@lo:400:kworker.0 Request processed in 27us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510582.829324:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788510582.829340:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861092608 00000100:00100000:3.0:1788510582.829343:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861092608 00000100:00100000:3.0:1788510582.829373:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861092736 00000100:00100000:3.0:1788510582.829377:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861092736 00000100:00100000:3.0:1788510582.829386:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788510582.829392:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861092608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510582.829422:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861092608:12345-0@lo:400:kworker.0 Request processed in 31us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510582.829427:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788510582.829436:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788510582.829439:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3287:x1875388861092736:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788510582.829473:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3287:x1875388861092736:12345-0@lo:8:kworker.0 Request processed in 32us (551us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788510582.829479:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788510582.829508:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929aaf0de300 x1875388861092992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510582.829518:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861092992:0@lo:400:kworker.0 00010000:00080000:3.0:1788510582.829526:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff929aaf0dc700 x1875388861092864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788510582.829534:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861092864:0@lo:400:kworker.0 00000100:00100000:3.0:1788510582.829565:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861092608:0@lo:400:kworker.0 00000100:00100000:3.0:1788510582.829608:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788510582.829612:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a84ec9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788510582.829616:0:3287:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788510582.829620:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861092736:0@lo:8:kworker.0 00000040:00080000:3.0:1788510582.832790:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788510582.840932:0:15855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788510582.840971:0:15855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788510582.840997:0:15855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fca00/0x3e734462ed66630 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66637 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.841009:0:15855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a813fca00/0x3e734462ed66630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66637 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788510582.841063:0:15855:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788510582.841065:0:15855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788510582.841066:0:15855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788510582.841067:0:15855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788510582.841068:0:15855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788510582.841070:0:15855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788510582.841071:0:15855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788510582.841073:0:15855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788510582.841074:0:15855:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788510582.841077:0:15855:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788510582.841079:0:15855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788510582.841081:0:15855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788510582.841082:0:15855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788510582.841083:0:15855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788510582.841084:0:15855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788510582.841085:0:15855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788510582.841086:0:15855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788510582.841087:0:15855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788510582.841087:0:15855:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788510582.841114:0:15855:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788510582.841135:0:15855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861093120:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788510582.841436:0:15855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510582.841477:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861093120 00000100:00100000:1.0:1788510582.841484:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861093120 00000100:00100000:1.0:1788510582.841525:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788510582.841533:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:15855:x1875388861093120:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788510582.841580:0:14443:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788510582.841593:0:14443:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788510582.842605:0:15855:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7c70540 going to sleep for 11 seconds 20000000:01000000:1.0:1788510582.906911:0:14443:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788510582.906930:0:14443:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788510582.906991:0:14467:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788510582.906997:0:14467:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788510582.907021:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.907040:0:14467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929aaec77e00/0x3e734462ed66526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6651f expref: 19 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.907049:0:14467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.907086:0:14467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929aaec77e00/0x3e734462ed66526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6651f expref: 19 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.907101:0:14467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929aaec77e00/0x3e734462ed66526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6651f expref: 19 pid: 14446 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510582.907140:0:14467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1875388861093248:0@lo:104: 00000100:00100000:2.0:1788510582.907888:0:14467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510582.907952:0:14467:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a82c64780 going to sleep for 11 seconds 00000100:00100000:1.0:1788510582.908193:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861093248 00000100:00100000:1.0:1788510582.908203:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861093248 00000100:00100000:1.0:1788510582.908645:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788510582.908663:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+3:14467:x1875388861093248:12345-0@lo:104: 00010000:00010000:1.0:1788510582.908691:0:14434:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.908788:0:14434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788510582.908795:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+3:14467:x1875388861093248:12345-0@lo:104: Request processed in 136us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510582.908802:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788510582.908834:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510582.908841:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.908848:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929ab4a69000 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:1.0:1788510582.908853:0:14439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.908882:0:14439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788510582.908889:0:14439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788510582.908895:0:14439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788510582.908936:0:14439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.908942:0:14439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788510582.908964:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.908971:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929ab4a69000/0x3e734462ed6651f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66526 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.908990:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510582.908992:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510582.908993:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510582.909007:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3290:1875388861093376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788510582.909047:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510582.909089:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861093376 00000100:00100000:1.0:1788510582.909093:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861093376 00010000:00010000:1.0:1788510582.909112:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929aaec77e00/0x3e734462ed66526 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6651f expref: 20 pid: 14446 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510582.909139:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788510582.909145:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+20:3290:x1875388861093376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510582.909164:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510582.909169:0:14438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929aaec77e00/0x3e734462ed66526 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6651f expref: 20 pid: 14446 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.909179:0:14438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929aaec77e00/0x3e734462ed66526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6651f expref: 20 pid: 14446 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510582.909540:0:14467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14467:1875388861093248:0@lo:104: 00010000:00010000:2.0:1788510582.909857:0:14467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.909908:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929aaec77e00/0x3e734462ed66526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6651f expref: 20 pid: 14446 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.909923:0:14438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.909930:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788510582.909945:0:14438:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002949416s 00010000:00010000:1.0:1788510582.909950:0:14438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.909956:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.909962:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.909968:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.909973:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fcc00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510582.909977:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.909993:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.910089:0:14467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510582.910097:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.910132:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.910141:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fcc00/0x3e734462ed66653 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510582.910155:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510582.910991:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:3290:x1875388861093376:12345-0@lo:103:ldlm_bl.0 Request processed in 1840us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510582.911002:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788510582.911127:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3290:1875388861093376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788510582.924956:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:15855:x1875388861093120:12345-0@lo:253:mount.lustre.0 Request processed in 83413us (83510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510582.924972:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788510582.925073:0:15855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4d56e3b-8589-453f-93c5-42174bfbbc5c:15855:1875388861093120:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788510582.925090:0:15855:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788510582.925093:0:15855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788510582.925095:0:15855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788510582.925096:0:15855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788510582.925097:0:15855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788510582.925098:0:15855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788510582.925100:0:15855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788510582.925101:0:15855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788510582.925103:0:15855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788510582.925105:0:15855:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788510582.925121:0:15855:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788510582.932166:0:15855:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788510582.933644:0:15855:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788510582.933845:0:15855:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788510582.934166:0:15855:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788510582.934709:0:15855:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788510582.934950:0:15855:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788510582.936507:0:15855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788510583.076095:0:15855:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788510583.076107:0:15855:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788510583.076144:0:15855:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788510583.076613:0:15855:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788510583.076636:0:15855:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788510583.076669:0:15855:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788510583.558420:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788510583.878136:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788510584.583023:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788510584.900400:0:14448:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788510584.900410:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff929aaeb69800 from 8 10000000:01000000:0.0:1788510584.900417:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788510584.900478:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eaf600/0x3e734462ed6665a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510584.900492:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a90eaf600/0x3e734462ed6665a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510584.900505:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a90eaf600/0x3e734462ed6665a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510584.900547:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861093504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788510584.900637:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510584.900701:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8bd52c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788510584.900795:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861093504 00000100:00100000:1.0:1788510584.900816:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861093504 00000100:00100000:1.0:1788510584.900870:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788510584.900881:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aafcf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:14448:x1875388861093504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788510584.900896:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510584.900910:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a83033200/0x3e734462ed66661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed6665a expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510584.900935:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83033200/0x3e734462ed66661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed6665a expref: 19 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510584.900946:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a83033200/0x3e734462ed66661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6665a expref: 19 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510584.900955:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033200, rc 0) 00000100:00100000:1.0:1788510584.900991:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aafcf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:14448:x1875388861093504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510584.900999:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788510584.901130:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861093504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510584.901145:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a90eaf600/0x3e734462ed6665a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66661 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510584.901154:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a90eaf600/0x3e734462ed6665a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed66661 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510584.901209:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861093632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788510584.901287:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510584.901313:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8bd52c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510584.901397:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861093632 00000100:00100000:2.0:1788510584.901404:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861093632 00000100:00100000:2.0:1788510584.901434:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788510584.901449:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:14448:x1875388861093632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788510584.901466:0:14443:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788510584.901484:0:14443:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788510584.901487:0:14443:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788510584.901586:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:14448:x1875388861093632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510584.901594:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788510584.901667:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861093632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788510584.901729:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788510584.901736:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a90eaf600/0x3e734462ed6665a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66661 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510584.901744:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a90eaf600/0x3e734462ed6665a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed66661 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510585.604432:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510586.628498:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510587.080303:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861093760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510587.080399:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510587.080541:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861093760 00000100:00100000:2.0:1788510587.080550:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861093760 00000100:00100000:2.0:1788510587.080617:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788510587.080628:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861093760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510587.080663:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788510587.080704:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510587.080712:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861093760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510587.080719:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788510587.080742:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861093760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788510587.658142:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788510588.107895:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788510588.107902:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788510588.107906:0:36:0:(import.c:65:import_set_state_nolock()) ffff929a84ec9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788510588.107920:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff929a84ec9000 using connection 192.168.201.104@tcp/0@lo 00000100:00100000:1.0:1788510588.107942:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9299836c6d80 x1875388861094144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788510588.108059:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861093888:0@lo:400:kworker.0 00000100:00100000:1.0:1788510588.108132:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510588.110325:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861094528:0@lo:400:kworker.0 00000100:00100000:1.0:1788510588.110396:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510588.110444:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510588.110451:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861094016:0@lo:400:kworker.0 00000100:00100000:1.0:1788510588.110494:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510588.110537:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861094144:0@lo:8:kworker.0 00000100:00100000:1.0:1788510588.110571:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510588.110601:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861094400:0@lo:400:kworker.0 00000100:00100000:1.0:1788510588.110625:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510588.110648:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510588.110654:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861094272:0@lo:400:kworker.0 00000100:00100000:1.0:1788510588.110677:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510588.110711:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861094528 00000100:00100000:1.0:1788510588.110721:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861094528 00000100:00100000:1.0:1788510588.110776:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861094400 00000100:00100000:1.0:1788510588.110779:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861094400 00000100:00100000:1.0:1788510588.110792:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861094272 00000100:00100000:1.0:1788510588.110794:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861094272 00000100:00100000:1.0:1788510588.110808:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788510588.110817:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861094528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510588.110873:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861094528:12345-0@lo:400:kworker.0 Request processed in 55us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510588.110880:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788510588.110922:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788510588.110928:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861094400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510588.110961:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875388861094400:12345-0@lo:400:kworker.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510588.110967:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788510588.110978:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788510588.110984:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861094272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510588.111011:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861094272:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510588.111017:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788510588.111035:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861094016 00000100:00100000:1.0:1788510588.111040:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861094016 00000100:00100000:1.0:1788510588.111067:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861094144 00000100:00100000:1.0:1788510588.111069:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861094144 00000100:00100000:1.0:1788510588.111080:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510588.111086:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861094016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510588.111117:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861094016:12345-0@lo:400:kworker.0 Request processed in 31us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510588.111123:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510588.111135:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788510588.111139:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3287:x1875388861094144:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788510588.112770:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861093888 00000100:00100000:2.0:1788510588.112787:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861093888 00000100:00100000:2.0:1788510588.112847:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788510588.112857:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82ca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:3288:x1875388861093888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510588.112943:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82ca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:3288:x1875388861093888:12345-0@lo:400:kworker.0 Request processed in 87us (4811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510588.112951:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1788510588.114081:0:15135:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:1.0:1788510588.115186:0:15135:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e734462ed66668 00002000:00100000:1.0:1788510588.115204:0:15135:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff929981faa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788510588.115208:0:15135:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788510588.115211:0:15135:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788510588.115627:0:15135:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788510588.115659:0:15135:0:(import.c:65:import_set_state_nolock()) ffff929981fa9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788510588.115755:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1875388861094144:12345-0@lo:8:kworker.0 Request processed in 4613us (5182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510588.115765:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788510588.115807:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788510588.115851:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9299836c7800 x1875388861094272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510588.115867:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861094272:0@lo:400:kworker.0 00010000:00080000:1.0:1788510588.115880:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9299836c6680 x1875388861094400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510588.115889:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3291:1875388861094400:0@lo:400:kworker.0 00000100:00100000:1.0:1788510588.115928:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861094016:0@lo:400:kworker.0 00000100:00100000:1.0:1788510588.115939:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861093888:0@lo:400:kworker.0 00010000:00080000:1.0:1788510588.115951:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9299836c4700 x1875388861094528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510588.115960:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861094528:0@lo:400:kworker.0 00010000:00080000:2.0:1788510588.117704:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9299836c6d80 x1875388861094144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788510613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788510588.117729:0:3287:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788510588.117742:0:3287:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788510588.117750:0:3287:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788510588.117766:0:3287:0:(import.c:65:import_set_state_nolock()) ffff929a84ec9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788510588.117779:0:3287:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788510588.117785:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3287:1875388861094144:0@lo:8:kworker.0 00000004:00080000:1.0:1788510588.118009:0:14476:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788510588.118037:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88310380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14476:1875388861094784:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788510588.118103:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510588.118133:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4b2a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788510588.118151:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861094784 00000100:00100000:1.0:1788510588.118169:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861094784 00000100:00100000:1.0:1788510588.118248:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788510588.118268:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14476:x1875388861094784:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788510588.120643:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861094656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788510588.120718:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510588.122562:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861094656 00000100:00100000:0.0:1788510588.122579:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861094656 00000100:00100000:0.0:1788510588.122649:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788510588.122670:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875388861094656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788510588.122719:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510588.122841:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875388861094656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510588.122848:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788510588.123670:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929a88311180 x1875388861094656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788510604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788510588.123700:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861094656:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788510588.124321:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1788510588.124844:0:15134:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788510588.124853:0:15134:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788510588.124858:0:15134:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000004:00080000:3.0:1788510588.125299:0:14475:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788510588.125741:0:14475:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 445944517350ns, next at 0ns, rc = 0 00002000:00010000:1.0:1788510588.141658:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.141671:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6666f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.141691:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.141696:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.141703:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6666f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.141726:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6666f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.141735:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6666f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.141743:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6666f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.141763:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.141782:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.141788:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6666f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.141810:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.141815:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6666f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.141825:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6666f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.141846:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6666f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.141853:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6666f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.141874:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.141876:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.141877:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.145383:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.145400:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed66676 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.145422:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.145429:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.145437:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed66676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.145455:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed66676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.145490:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed66676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.145499:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed66676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.145527:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.145547:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.145554:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed66676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.145563:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.145568:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed66676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.145578:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed66676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.145602:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed66676 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.145610:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed66676 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.145628:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.145636:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.145638:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.146109:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.146116:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed6667d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.146126:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.146129:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.146133:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed6667d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.146143:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed6667d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.146152:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed6667d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.148287:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed6667d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.148315:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.148335:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.148342:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed6667d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.148350:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.148356:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed6667d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.148383:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed6667d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.148409:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed6667d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.148417:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed6667d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.148438:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.148440:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.148442:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.150456:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.150471:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66684 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.150497:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.150502:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.150508:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.150523:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.150533:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.150550:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.150566:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.150578:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.150584:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.150592:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.150598:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.150610:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66684 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.150627:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66684 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.150634:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66684 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.150653:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.150656:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.150657:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.152038:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.152061:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6668b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.152076:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.152080:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.152086:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6668b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.152098:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6668b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.154343:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6668b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.154353:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6668b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.154397:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.154415:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.154422:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6668b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.154430:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.154435:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6668b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.154445:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6668b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.154500:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6668b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.154508:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed6668b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.154529:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.154531:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.154533:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.158570:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.158586:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed66692 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.158608:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.158614:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.158620:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed66692 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.158637:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed66692 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.158650:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed66692 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.158658:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed66692 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.158694:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.158711:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.158718:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed66692 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.158726:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032c00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.158730:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed66692 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.158740:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed66692 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.158759:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed66692 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.158768:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed66692 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.158784:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.158786:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.158787:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.161095:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.161889:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed66699 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.161905:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.161920:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.161926:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed66699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.161941:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed66699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.161951:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed66699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.161959:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed66699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.161975:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.161988:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.161994:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed66699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.162001:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033e00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.162006:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed66699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.162014:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed66699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.162027:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed66699 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.162044:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed66699 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.162059:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.162061:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.162063:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.163952:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.163970:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.163986:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.163990:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.163997:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.164014:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.164025:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.164033:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.164053:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.164064:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.164076:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.164083:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.164088:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.164097:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.164112:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.164120:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.164135:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.164136:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.164138:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.166098:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.166108:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.166124:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.166128:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.166134:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.168395:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.168421:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.168430:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.168457:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.168487:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.168493:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.168502:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032c00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.168508:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.168519:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.168537:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.168544:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.168589:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.168591:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.168594:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.169440:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.169449:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed666ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.169462:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.169466:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.169472:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed666ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.169495:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed666ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.169503:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed666ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.169509:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed666ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.169532:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788510588.169949:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.169955:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed666b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.169974:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.169977:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.169981:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed666b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.169991:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed666b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.169998:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed666b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.170004:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed666b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.170021:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788510588.170035:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788510588.170040:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed666ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.170048:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033e00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.170052:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed666ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.170060:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed666ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.170083:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed666ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.170090:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a53d146c/0x3e734462ed666ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510588.170318:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510588.170463:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510588.170471:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed666b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510588.170508:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:0.0:1788510588.170512:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed666b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510588.170521:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed666b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510588.170535:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed666b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510588.170543:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bdf0c1f/0x3e734462ed666b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510588.170562:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510588.170563:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510588.170565:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510588.170570:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510588.170572:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.171802:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.171809:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.171811:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.173736:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.173747:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.173763:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.173768:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.173774:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.173789:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.173799:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.173806:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.173838:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788510588.174405:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510588.174413:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.174422:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510588.174427:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.174436:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.174457:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.174464:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.174497:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.174499:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.174501:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.174884:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.174890:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed666c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.174899:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.174902:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.174907:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed666c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.174917:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed666c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.174925:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed666c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.174932:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed666c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.174947:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788510588.175586:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.175594:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed666ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175604:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.175615:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.175619:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed666ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175630:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed666ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175640:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed666ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175647:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed666ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175663:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788510588.175676:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788510588.175681:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed666c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175689:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.175693:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed666c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175702:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed666c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175714:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed666c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175735:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed666c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175751:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.175755:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed666ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175762:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033c00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.175765:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed666ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175773:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed666ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175784:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed666ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175790:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed666ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.175801:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.175803:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.175804:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.176379:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.176607:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.176615:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed666d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.176633:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.176637:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.176643:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed666d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.176656:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed666d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.176665:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed666d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.176672:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed666d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.176739:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788510588.177433:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.177440:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed666d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.177450:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1788510588.177453:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.177458:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed666d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.177468:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed666d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.177501:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed666d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.177508:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed666d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.180460:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788510588.180490:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed666d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.180521:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032200 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510588.180527:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed666d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.180540:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed666d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.180566:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed666d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.180574:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091e108cb/0x3e734462ed666d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.180601:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510588.180605:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed666d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.180612:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510588.180615:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed666d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.180623:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed666d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.180633:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed666d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.180648:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.180650:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.180652:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.183046:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788510588.183064:0:15134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed666d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510588.183389:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.184030:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.184040:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.184057:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788510588.184063:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.184071:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.184090:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.184119:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.184141:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.184829:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788510588.185811:0:16132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510588.185903:0:16132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.185919:0:16132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032c00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510588.185926:0:16132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.185939:0:16132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.185967:0:16132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.185975:0:16132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090b76a85/0x3e734462ed666df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.186017:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.186020:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.186022:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.191667:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.191680:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.191715:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788510588.191722:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.191729:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.191749:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.191761:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.191770:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.191797:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.191814:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.191821:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.191837:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.191842:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.191853:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.191875:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.191883:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.191906:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.191908:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.191909:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.193400:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.193414:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed666ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.193429:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788510588.193433:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.193438:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed666ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.193452:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed666ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.193473:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed666ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.193490:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed666ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.193509:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.193524:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.193531:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed666ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.193538:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.193543:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed666ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.193554:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed666ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.193571:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed666ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.193580:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed666ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.193603:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.193613:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.193615:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.194708:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.194718:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.194731:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788510588.194735:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.194740:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.194753:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.194763:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.194770:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.194836:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788510588.196645:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.196657:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.196672:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788510588.196676:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.196682:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.196708:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.196720:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.196729:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.200364:0:16132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788510588.200382:0:16132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.200417:0:16132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510588.200422:0:16132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.200434:0:16132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.200457:0:16132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.200465:0:16132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f68b2a56/0x3e734462ed666f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.200497:0:16132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510588.200501:0:16132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.200508:0:16132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510588.200511:0:16132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.200518:0:16132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.200527:0:16132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.200539:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.200540:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.200542:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.200929:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788510588.200937:0:15134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed666fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788510588.201941:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.201950:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed66702 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.201964:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788510588.201969:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.201975:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed66702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.201988:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed66702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.202010:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed66702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.202017:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed66702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.202033:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788510588.202046:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.202051:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed66702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.202059:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032600 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.202063:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed66702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.202072:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed66702 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.202087:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed66702 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.202094:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000101d9b2c/0x3e734462ed66702 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.202300:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.202910:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.202918:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.202921:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.206110:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.206124:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66709 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.206142:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788510588.206147:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.206248:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.206270:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.206285:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.206293:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.206318:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788510588.206964:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.206973:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed66710 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.206982:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788510588.206987:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.206990:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed66710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.207008:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed66710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.207017:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed66710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.207025:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed66710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.207048:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788510588.207064:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788510588.207071:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.207079:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:1.0:1788510588.207084:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.207093:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66709 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.207110:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66709 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.207118:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66709 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.207142:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788510588.207145:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed66710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.207152:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510588.209295:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.209469:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed66710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.209503:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed66710 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.209527:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed66710 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.209536:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091fc710d/0x3e734462ed66710 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.209563:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.209565:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510588.209567:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.212002:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.212022:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed66717 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.212045:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788510588.212050:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.212065:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed66717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.212087:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed66717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.212098:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed66717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.214944:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed66717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.215064:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788510588.215938:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.215946:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed6671e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.215962:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788510588.215967:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.215972:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed6671e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.215987:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed6671e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.215997:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed6671e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.216016:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed6671e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.220320:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788510588.220339:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed66717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.220354:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033c00 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510588.220360:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed66717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.220373:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed66717 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.220397:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed66717 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.220406:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dca8e4d/0x3e734462ed66717 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.220430:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510588.220434:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed6671e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.220453:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510588.220458:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed6671e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.220467:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed6671e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.220492:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed6671e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.220501:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.220503:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.220504:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788510588.222620:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788510588.228650:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788510588.228672:0:15134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cf8fa9b/0x3e734462ed6671e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510588.229634:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788510588.231590:0:15134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788510588.231609:0:15134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66725 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.231630:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788510588.231636:0:15134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510588.231642:0:15134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.231658:0:15134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.231667:0:15134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.231674:0:15134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510588.231711:0:15134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788510588.231954:0:15134:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1788510588.232075:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14476:x1875388861094784:12345-0@lo:5:osp-pre-1-0.0 Request processed in 113805us (113967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510588.232088:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788510588.232170:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88310380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14476:1875388861094784:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788510588.232193:0:14476:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788510588.232257:0:14476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14476:1875388861094912:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788510588.232298:0:14476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788510588.232339:0:14440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788510588.232346:0:14476:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7c70540 going to sleep for 11 seconds 00010000:00010000:3.0:1788510588.232348:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.232358:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033800 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510588.232363:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.232373:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66725 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.232395:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66725 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.232411:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f704ae2/0x3e734462ed66725 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510588.232434:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.232436:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510588.232437:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510588.233344:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861094912 00000100:00100000:1.0:1788510588.233357:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861094912 00000100:00100000:1.0:1788510588.233459:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788510588.233470:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14476:x1875388861094912:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788510588.233538:0:15136:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788510588.255788:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14476:x1875388861094912:12345-0@lo:5:osp-pre-1-0.0 Request processed in 22306us (23475us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788510588.255815:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788510588.256293:0:14476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14476:1875388861094912:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788510588.256315:0:14476:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788510588.676420:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510589.700875:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788510590.525554:0:16214:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg104-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788510590.733956:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510591.755341:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510592.197720:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861095040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788510592.197813:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510592.199508:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861095040 00000100:00100000:2.0:1788510592.199523:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861095040 00000100:00100000:2.0:1788510592.199590:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788510592.199601:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861095040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510592.199638:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788510592.199675:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510592.199697:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861095040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510592.199702:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788510592.199859:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861095040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788510592.782807:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510593.048626:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510593.053517:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852708736 00000100:00100000:2.0:1788510593.053536:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852708736 00000100:00100000:2.0:1788510593.053599:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 75 00000100:00100000:2.0:1788510593.053610:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82ca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2339:x1875388852708736:12345-192.168.201.4@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788510593.053639:0:14446:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0@192.168.201.4@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1788510593.053671:0:14446:0:(genops.c:1385:class_connect()) connect: client 48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0, cookie 0x3e734462ed6672c 00000100:00080000:2.0:1788510593.053828:0:14446:0:(import.c:65:import_set_state_nolock()) ffff9299836c8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788510593.053923:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82ca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+5:2339:x1875388852708736:12345-192.168.201.4@tcp:250:mount.lustre.0 Request processed in 313us (5308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510593.053932:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 75 00000100:00100000:3.0:1788510593.061469:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510593.062125:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852708864 00000100:00100000:2.0:1788510593.062136:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852708864 00000100:00100000:2.0:1788510593.062196:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 76 00000100:00100000:2.0:1788510593.062205:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82caac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+5:13747:x1875388852708864:12345-192.168.201.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788510593.062258:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510593.062281:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fc400/0x3e734462ed66733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc735c8 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510593.062313:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fc400/0x3e734462ed66733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735c8 expref: 6 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510593.062326:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fc400/0x3e734462ed66733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735c8 expref: 6 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510593.062336:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fc400, rc 0) 00000100:00100000:2.0:1788510593.062402:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82caac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+6:13747:x1875388852708864:12345-192.168.201.4@tcp:101:mount.lustre.0 Request processed in 189us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510593.062410:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 76 00000100:00100000:1.0:1788510593.069675:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510593.078146:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852708992 00000100:00100000:0.0:1788510593.078164:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852708992 00000100:00100000:0.0:1788510593.078352:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 77 00000100:00100000:0.0:1788510593.078366:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+6:13747:x1875388852708992:12345-192.168.201.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788510593.078725:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+6:13747:x1875388852708992:12345-192.168.201.4@tcp:501:mount.lustre.0 Request processed in 360us (9060us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788510593.078734:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 77 00000100:00100000:3.0:1788510593.086351:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510593.100013:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852709120 00000100:00100000:2.0:1788510593.100042:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852709120 00000040:00080000:3.0:1788510593.100865:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788510593.103691:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 78 00000100:00100000:0.0:1788510593.103706:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+6:13747:x1875388852709120:12345-192.168.201.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788510593.103724:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510593.103744:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eafe00/0x3e734462ed6673a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc735cf expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510593.103776:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eafe00/0x3e734462ed6673a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735cf expref: 7 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510593.103788:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eafe00/0x3e734462ed6673a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735cf expref: 7 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510593.103797:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eafe00, rc 0) 00000100:00100000:0.0:1788510593.103870:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+7:13747:x1875388852709120:12345-192.168.201.4@tcp:101:mount.lustre.0 Request processed in 166us (17530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510593.103876:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 78 00000100:00100000:3.0:1788510593.107542:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510593.107635:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852709248 00000100:00100000:0.0:1788510593.107647:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852709248 00000100:00100000:0.0:1788510593.107709:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 79 00000100:00100000:0.0:1788510593.107721:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+7:13747:x1875388852709248:12345-192.168.201.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788510593.108059:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+8:13747:x1875388852709248:12345-192.168.201.4@tcp:501:mount.lustre.0 Request processed in 339us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510593.108067:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 79 00000100:00100000:2.0:1788510593.111473:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510593.111591:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852709376 00000100:00100000:1.0:1788510593.111605:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852709376 00000100:00100000:1.0:1788510593.112186:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 80 00000100:00100000:1.0:1788510593.112201:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82caa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+8:13747:x1875388852709376:12345-192.168.201.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788510593.113824:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82caa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+8:13747:x1875388852709376:12345-192.168.201.4@tcp:503:mount.lustre.0 Request processed in 1617us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510593.113838:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 80 00000100:00100000:3.0:1788510593.119365:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510593.119675:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852709504 00000100:00100000:2.0:1788510593.119685:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852709504 00000100:00100000:2.0:1788510593.119744:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 81 00000100:00100000:2.0:1788510593.119755:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a82ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+8:13766:x1875388852709504:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788510593.120022:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a82ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+8:13766:x1875388852709504:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 267us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510593.120030:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 81 00000100:00100000:3.0:1788510593.140833:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510593.141734:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852709632 00000100:00100000:1.0:1788510593.141750:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852709632 00000100:00100000:1.0:1788510593.141815:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 82 00000100:00100000:1.0:1788510593.141826:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+8:13766:x1875388852709632:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788510593.142854:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+8:13766:x1875388852709632:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 1021us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510593.142878:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 82 00000100:00100000:3.0:1788510593.153638:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510593.153755:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852709760 00000100:00100000:0.0:1788510593.153768:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852709760 00000100:00100000:0.0:1788510593.153839:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 83 00000100:00100000:0.0:1788510593.153852:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+8:13747:x1875388852709760:12345-192.168.201.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788510593.153869:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510593.153888:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eaf800/0x3e734462ed66741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc735f9 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510593.153917:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eaf800/0x3e734462ed66741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735f9 expref: 9 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510593.153929:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eaf800/0x3e734462ed66741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc735f9 expref: 9 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510593.153940:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf800, rc 0) 00000100:00100000:0.0:1788510593.154002:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+9:13747:x1875388852709760:12345-192.168.201.4@tcp:101:mount.lustre.0 Request processed in 153us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510593.154014:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 83 00000100:00100000:3.0:1788510593.167828:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510593.168641:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852709888 00000100:00100000:1.0:1788510593.168651:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852709888 00000100:00100000:1.0:1788510593.168732:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 84 00000100:00100000:1.0:1788510593.168742:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+9:13747:x1875388852709888:12345-192.168.201.4@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788510593.168763:0:14444:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788510593.168785:0:14444:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788510593.168787:0:14444:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788510593.168789:0:14444:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788510593.168791:0:14444:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788510593.170849:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+9:13747:x1875388852709888:12345-192.168.201.4@tcp:256:mount.lustre.0 Request processed in 2096us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510593.170864:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 84 00000100:00100000:3.0:1788510593.176518:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510593.176912:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852710016 00000100:00100000:2.0:1788510593.176922:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852710016 00000100:00100000:2.0:1788510593.176979:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 85 00000100:00100000:2.0:1788510593.176987:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+9:13747:x1875388852710016:12345-192.168.201.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788510593.177001:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510593.177084:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fc800/0x3e734462ed66748 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73600 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510593.177573:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fc800/0x3e734462ed66748 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73600 expref: 10 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510593.177586:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fc800/0x3e734462ed66748 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73600 expref: 10 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510593.177595:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fc800, rc 0) 00000100:00100000:2.0:1788510593.177660:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+10:13747:x1875388852710016:12345-192.168.201.4@tcp:101:mount.lustre.0 Request processed in 671us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510593.177668:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 85 00000100:00100000:3.0:1788510593.182958:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510593.183278:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852710144 00000100:00100000:1.0:1788510593.183287:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852710144 00000100:00100000:1.0:1788510593.183350:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 86 00000100:00100000:1.0:1788510593.183360:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+10:13747:x1875388852710144:12345-192.168.201.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788510593.183660:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+10:13747:x1875388852710144:12345-192.168.201.4@tcp:501:mount.lustre.0 Request processed in 301us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510593.183669:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 86 00000100:00100000:3.0:1788510593.186955:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510593.187080:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852710272 00000100:00100000:0.0:1788510593.187196:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852710272 00000100:00100000:0.0:1788510593.187283:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 87 00000100:00100000:0.0:1788510593.187305:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+10:13747:x1875388852710272:12345-192.168.201.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788510593.187651:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+10:13747:x1875388852710272:12345-192.168.201.4@tcp:503:mount.lustre.0 Request processed in 346us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510593.187659:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 87 00000100:00100000:3.0:1788510593.195469:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510593.195901:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852710400 00000100:00100000:2.0:1788510593.195912:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852710400 00000100:00100000:2.0:1788510593.196146:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 88 00000100:00100000:2.0:1788510593.196156:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+10:13771:x1875388852710400:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788510593.196693:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+10:13771:x1875388852710400:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 536us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510593.196709:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 88 00000100:00100000:3.0:1788510593.213977:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510593.217748:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852710528 00000100:00100000:1.0:1788510593.217766:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852710528 00000100:00100000:1.0:1788510593.218040:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 89 00000100:00100000:1.0:1788510593.218053:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+10:13771:x1875388852710528:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788510593.218830:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+10:13771:x1875388852710528:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 776us (4872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510593.218847:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 89 00000100:00100000:0.0:1788510593.222762:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861095168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510593.222843:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510593.223211:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861095168 00000100:00100000:2.0:1788510593.223220:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861095168 00000100:00100000:2.0:1788510593.223293:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788510593.223303:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861095168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788510593.223334:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510593.223408:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1875388861095168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510593.223414:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788510593.228463:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788510593.230058:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510593.231551:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852710656 00000100:00100000:2.0:1788510593.231566:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852710656 00000100:00100000:2.0:1788510593.231622:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:2.0:1788510593.231631:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2339:x1875388852710656:12345-192.168.201.4@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788510593.231660:0:14452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a429815a-88fd-43fc-b7af-9ff8bdb64520@192.168.201.4@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:2.0:1788510593.231702:0:14452:0:(genops.c:1385:class_connect()) connect: client a429815a-88fd-43fc-b7af-9ff8bdb64520, cookie 0x3e734462ed6674f 00000004:00100000:2.0:1788510593.231731:0:14452:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:2.0:1788510593.231738:0:14452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788510593.231979:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861095552:0@lo:400:kworker.0 00000100:00100000:2.0:1788510593.232053:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510593.232091:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788510593.232112:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861095680:0@lo:400:kworker.0 00000100:00100000:2.0:1788510593.232134:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510593.232172:0:14451:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788510593.232180:0:14451:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788510593.234459:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861095552 00000100:00100000:2.0:1788510593.234473:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861095552 00000100:00100000:2.0:1788510593.234529:0:14451:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788510593.234536:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861095680 00000100:00100000:2.0:1788510593.234539:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861095680 00000100:00100000:2.0:1788510593.234566:0:14451:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788510593.234575:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788510593.234598:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861095552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510593.234681:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861095552:12345-0@lo:400:kworker.0 Request processed in 85us (2627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510593.234688:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788510593.234702:0:14451:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788510593.234707:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788510593.234712:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861095680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510593.234739:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861095680:12345-0@lo:400:kworker.0 Request processed in 27us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510593.234745:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788510593.234783:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaea79880 x1875388861095680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510593.234797:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861095680:0@lo:400:kworker.0 00010000:00080000:2.0:1788510593.234810:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaea7a680 x1875388861095552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788510593.234818:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861095552:0@lo:400:kworker.0 00000100:00080000:2.0:1788510593.234849:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510593.239776:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861095296:0@lo:400:kworker.0 00000100:00100000:1.0:1788510593.239933:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510593.240605:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861095808:0@lo:400:kworker.0 00000100:00100000:1.0:1788510593.240641:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510593.240666:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788510593.240672:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861095424:0@lo:400:kworker.0 00000100:00100000:1.0:1788510593.240697:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510593.241378:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861095296 00000100:00100000:3.0:1788510593.241464:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861095296 00000100:00100000:1.0:1788510593.245889:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861095808 00000100:00100000:1.0:1788510593.245904:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861095808 00000100:00100000:1.0:1788510593.245990:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788510593.246002:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861095808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510593.246132:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861095808:12345-0@lo:400:kworker.0 Request processed in 132us (5490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510593.246141:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788510593.246166:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861095424 00000100:00100000:1.0:1788510593.246170:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861095424 00000100:00100000:1.0:1788510593.246196:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788510593.246203:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88312680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861095424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510593.246256:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88312680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861095424:12345-0@lo:400:kworker.0 Request processed in 53us (5558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510593.246263:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788510593.246305:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861095424:0@lo:400:kworker.0 00010000:00080000:1.0:1788510593.246333:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff929aaea78700 x1875388861095808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788510609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788510593.246370:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861095808:0@lo:400:kworker.0 00000100:00080000:1.0:1788510593.246412:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510593.246539:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861095168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510593.249385:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788510593.249433:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:3288:x1875388861095296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510593.249535:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:3288:x1875388861095296:12345-0@lo:400:kworker.0 Request processed in 106us (9601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510593.249542:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788510593.250335:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861095296:0@lo:400:kworker.0 00000100:00080000:2.0:1788510593.286254:0:14452:0:(import.c:65:import_set_state_nolock()) ffff9299836ca800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788510593.286509:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2339:x1875388852710656:12345-192.168.201.4@tcp:38:mount.lustre.0 Request processed in 54875us (56457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510593.286533:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:3.0:1788510593.291845:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510593.291896:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510593.291925:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852710912 00000100:00100000:3.0:1788510593.291935:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852710912 00000100:00100000:3.0:1788510593.291990:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852710784 00000100:00100000:3.0:1788510593.291994:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852710784 00000100:00100000:3.0:1788510593.292379:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 5 00000100:00100000:3.0:1788510593.292403:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:13747:x1875388852710912:12345-192.168.201.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788510593.292445:0:14453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788510593.292526:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:13747:x1875388852710912:12345-192.168.201.4@tcp:41:mount.lustre.0 Request processed in 136us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510593.292535:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 5 00000100:00100000:3.0:1788510593.292553:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:3.0:1788510593.292560:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:0:x1875388852710784:12345-192.168.201.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788510593.292570:0:14453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788510593.292663:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:0:x1875388852710784:12345-192.168.201.4@tcp:41:mount.lustre.0 Request processed in 103us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510593.292670:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00080000:3.0:1788510593.292692:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788510593.303251:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510593.303290:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852711040 00000100:00100000:2.0:1788510593.303572:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852711040 00000100:00100000:2.0:1788510593.303700:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:2.0:1788510593.303711:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:13747:x1875388852711040:12345-192.168.201.4@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788510593.303788:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:13747:x1875388852711040:12345-192.168.201.4@tcp:40:mount.lustre.0 Request processed in 79us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510593.303898:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:0.0:1788510593.306833:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510593.306912:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510593.306938:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510593.306958:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852711424 00000100:00100000:1.0:1788510593.306968:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852711424 00000100:00100000:3.0:1788510593.307111:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852711168 00000100:00100000:3.0:1788510593.307116:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852711168 00000100:00100000:3.0:1788510593.307141:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852711296 00000100:00100000:3.0:1788510593.307144:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852711296 00000100:00100000:3.0:1788510593.307158:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:3.0:1788510593.307166:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2339:x1875388852711168:12345-192.168.201.4@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788510593.307209:0:15136:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a429815a-88fd-43fc-b7af-9ff8bdb64520@192.168.201.4@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:3.0:1788510593.307270:0:15136:0:(genops.c:1385:class_connect()) connect: client a429815a-88fd-43fc-b7af-9ff8bdb64520, cookie 0x3e734462ed66756 00000100:00100000:2.0:1788510593.307272:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:2.0:1788510593.307281:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:13747:x1875388852711424:12345-192.168.201.4@tcp:33:mount.lustre.0 00002000:00100000:3.0:1788510593.307282:0:15136:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a429815a-88fd-43fc-b7af-9ff8bdb64520/ffff92998366e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788510593.307294:0:15136:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788510593.307780:0:15136:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788510593.307814:0:15136:0:(import.c:65:import_set_state_nolock()) ffff92998366d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788510593.307880:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2339:x1875388852711168:12345-192.168.201.4@tcp:8:mount.lustre.0 Request processed in 714us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510593.307888:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 9 00000001:00080000:2.0:1788510593.307894:0:7621:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:3.0:1788510593.307907:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:3.0:1788510593.307912:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2339:x1875388852711296:12345-192.168.201.4@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788510593.307926:0:15136:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a429815a-88fd-43fc-b7af-9ff8bdb64520@192.168.201.4@tcp t0 exp 0000000000000000 cur 451 last 0 00000001:00100000:2.0:1788510593.307934:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788510593.307943:0:15136:0:(genops.c:1385:class_connect()) connect: client a429815a-88fd-43fc-b7af-9ff8bdb64520, cookie 0x3e734462ed6675d 00002000:00100000:3.0:1788510593.307948:0:15136:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a429815a-88fd-43fc-b7af-9ff8bdb64520/ffff92998366f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788510593.307955:0:15136:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788510593.308679:0:15136:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788510593.308706:0:15136:0:(import.c:65:import_set_state_nolock()) ffff92998366c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788510593.308753:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2339:x1875388852711296:12345-192.168.201.4@tcp:8:mount.lustre.0 Request processed in 838us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510593.308762:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 10 00000004:00080000:3.0:1788510593.309961:0:14455:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2491us 00000004:00200000:3.0:1788510593.317827:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788510593.317966:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:13747:x1875388852711424:12345-192.168.201.4@tcp:33:mount.lustre.0 Request processed in 10681us (11049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510593.317986:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:0.0:1788510593.436117:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510593.436206:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852711552 00000100:00100000:3.0:1788510593.436216:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852711552 00000100:00100000:3.0:1788510593.436309:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:3.0:1788510593.436319:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:13792:x1875388852711552:12345-192.168.201.4@tcp:101:mkdir.0 00010000:00010000:3.0:1788510593.436417:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510593.436445:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66764 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7362a expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510593.436506:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed6676b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510593.436521:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed6676b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510593.436536:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed6676b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510593.436570:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788510593.436573:0:14452:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788510593.436605:0:14452:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed6676b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510593.436632:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68c00/0x3e734462ed66764 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7362a expref: 8 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510593.436651:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed6676b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7362a expref: 7 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510593.436680:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:3.0:1788510593.436683:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788510593.436687:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68600, rc 0) 00000100:00100000:3.0:1788510593.436752:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:13792:x1875388852711552:12345-192.168.201.4@tcp:101:mkdir.0 Request processed in 435us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510593.436760:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 8 00010000:00010000:3.0:1788510593.797456:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788510594.830113:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510595.461449:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510595.464316:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852711680 00000100:00100000:1.0:1788510595.464336:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852711680 00000100:00100000:1.0:1788510595.464519:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:1.0:1788510595.464532:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:13845:x1875388852711680:12345-192.168.201.4@tcp:41:lfs.0 00000004:00000024:1.0:1788510595.464579:0:14451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788510595.464686:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:13845:x1875388852711680:12345-192.168.201.4@tcp:41:lfs.0 Request processed in 157us (3246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510595.464693:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00080000:3.0:1788510595.471285:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510595.472364:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510595.472453:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852711808 00000100:00100000:2.0:1788510595.472464:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852711808 00000100:00100000:2.0:1788510595.472547:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:2.0:1788510595.472559:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:13845:x1875388852711808:12345-192.168.201.4@tcp:13:lfs.0 00002000:00000024:2.0:1788510595.472599:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510595.472693:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:13845:x1875388852711808:12345-192.168.201.4@tcp:13:lfs.0 Request processed in 136us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510595.472702:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00080000:3.0:1788510595.472837:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510595.479942:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510595.483345:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852711936 00000100:00100000:2.0:1788510595.483372:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852711936 00000100:00100000:2.0:1788510595.483517:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:2.0:1788510595.483544:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:13845:x1875388852711936:12345-192.168.201.4@tcp:13:lfs.0 00002000:00000024:2.0:1788510595.483582:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510595.483681:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:13845:x1875388852711936:12345-192.168.201.4@tcp:13:lfs.0 Request processed in 141us (3749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510595.483687:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00080000:3.0:1788510595.491830:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788510595.779760:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510595.779927:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852712064 00000100:00100000:2.0:1788510595.779937:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852712064 00000100:00100000:2.0:1788510595.780010:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 91 00000100:00100000:2.0:1788510595.780022:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+10:13874:x1875388852712064:12345-192.168.201.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788510595.780039:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510595.780057:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fcc00/0x3e734462ed66772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73631 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510595.780094:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fcc00/0x3e734462ed66772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73631 expref: 11 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510595.780107:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fcc00/0x3e734462ed66772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73631 expref: 11 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510595.780127:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fcc00, rc 0) 00000100:00100000:2.0:1788510595.780196:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+11:13874:x1875388852712064:12345-192.168.201.4@tcp:101:mount.lustre.0 Request processed in 176us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510595.780204:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 91 00000100:00100000:1.0:1788510595.801725:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510595.801847:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852712192 00000100:00100000:0.0:1788510595.801858:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852712192 00000100:00100000:0.0:1788510595.801923:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 92 00000100:00100000:0.0:1788510595.801933:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aade49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+11:13874:x1875388852712192:12345-192.168.201.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788510595.802415:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aade49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+11:13874:x1875388852712192:12345-192.168.201.4@tcp:501:mount.lustre.0 Request processed in 481us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510595.802424:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 92 00000100:00100000:1.0:1788510595.809364:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510595.809474:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852712320 00000100:00100000:0.0:1788510595.809487:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852712320 00000100:00100000:0.0:1788510595.809558:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 93 00000100:00100000:0.0:1788510595.809569:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+11:13874:x1875388852712320:12345-192.168.201.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788510595.809813:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+11:13874:x1875388852712320:12345-192.168.201.4@tcp:503:mount.lustre.0 Request processed in 245us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510595.809821:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 93 00000100:00100000:1.0:1788510595.837972:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510595.838065:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852712448 00000100:00100000:0.0:1788510595.838075:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852712448 00000100:00100000:0.0:1788510595.838136:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 94 00000100:00100000:0.0:1788510595.838146:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+11:13882:x1875388852712448:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788510595.838472:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+11:13882:x1875388852712448:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 327us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510595.838480:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 94 00010000:00010000:3.0:1788510595.844908:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510595.873703:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510595.874262:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852712576 00000100:00100000:2.0:1788510595.874273:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852712576 00000100:00100000:2.0:1788510595.874336:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 95 00000100:00100000:2.0:1788510595.874372:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+11:13882:x1875388852712576:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788510595.874669:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+11:13882:x1875388852712576:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 324us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510595.874677:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 95 00000100:00100000:1.0:1788510595.922322:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510595.922881:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852712704 00000100:00100000:2.0:1788510595.922894:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852712704 00000100:00100000:2.0:1788510595.922967:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 96 00000100:00100000:2.0:1788510595.922978:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+11:13874:x1875388852712704:12345-192.168.201.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788510595.923005:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510595.923026:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a813fc200/0x3e734462ed66779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7365b expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510595.923057:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a813fc200/0x3e734462ed66779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7365b expref: 12 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510595.923070:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a813fc200/0x3e734462ed66779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7365b expref: 12 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510595.923080:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fc200, rc 0) 00000100:00100000:2.0:1788510595.923777:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+12:13874:x1875388852712704:12345-192.168.201.4@tcp:101:mount.lustre.0 Request processed in 797us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510595.923786:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 96 00000100:00100000:1.0:1788510595.933589:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510595.933743:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852712832 00000100:00100000:0.0:1788510595.933754:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852712832 00000100:00100000:0.0:1788510595.933815:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 97 00000100:00100000:0.0:1788510595.933826:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+12:13874:x1875388852712832:12345-192.168.201.4@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788510595.933854:0:14446:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788510595.933882:0:14446:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788510595.933886:0:14446:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788510595.933889:0:14446:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788510595.933891:0:14446:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788510595.937391:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+12:13874:x1875388852712832:12345-192.168.201.4@tcp:256:mount.lustre.0 Request processed in 3556us (3799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510595.937407:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 97 00000100:00100000:2.0:1788510595.941560:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510595.941712:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852712960 00000100:00100000:0.0:1788510595.941722:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852712960 00000100:00100000:0.0:1788510595.941786:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 98 00000100:00100000:0.0:1788510595.941796:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+12:13874:x1875388852712960:12345-192.168.201.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788510595.941815:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510595.941834:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eaf400/0x3e734462ed66780 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73662 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510595.941864:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eaf400/0x3e734462ed66780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73662 expref: 13 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510595.941877:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eaf400/0x3e734462ed66780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73662 expref: 13 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510595.941886:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaf400, rc 0) 00000100:00100000:0.0:1788510595.941954:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13874:x1875388852712960:12345-192.168.201.4@tcp:101:mount.lustre.0 Request processed in 156us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510595.941962:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 98 00000100:00100000:1.0:1788510595.944667:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510595.944753:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852713088 00000100:00100000:0.0:1788510595.944764:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852713088 00000100:00100000:0.0:1788510595.944874:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 99 00000100:00100000:0.0:1788510595.944884:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13874:x1875388852713088:12345-192.168.201.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788510595.945258:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13874:x1875388852713088:12345-192.168.201.4@tcp:501:mount.lustre.0 Request processed in 374us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510595.945267:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 99 00000100:00100000:1.0:1788510595.955151:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510595.958554:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852713216 00000100:00100000:2.0:1788510595.958573:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852713216 00000100:00100000:2.0:1788510595.958809:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 100 00000100:00100000:2.0:1788510595.958821:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13874:x1875388852713216:12345-192.168.201.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788510595.961533:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13874:x1875388852713216:12345-192.168.201.4@tcp:503:mount.lustre.0 Request processed in 2705us (6391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510595.961560:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 100 00000100:00100000:1.0:1788510595.972359:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510595.972459:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852713344 00000100:00100000:0.0:1788510595.972471:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852713344 00000100:00100000:0.0:1788510595.972540:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 101 00000100:00100000:0.0:1788510595.972571:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13886:x1875388852713344:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788510595.972859:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13886:x1875388852713344:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 289us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510595.972867:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 101 00000100:00100000:1.0:1788510595.987846:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510595.988257:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852713472 00000100:00100000:3.0:1788510595.988267:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852713472 00000100:00100000:3.0:1788510595.988330:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 102 00000100:00100000:3.0:1788510595.988351:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13886:x1875388852713472:12345-192.168.201.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788510595.988808:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13886:x1875388852713472:12345-192.168.201.4@tcp:502:llog_process_th.0 Request processed in 467us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510595.988818:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 102 00000100:00100000:1.0:1788510596.007557:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510596.008804:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852713600 00000100:00100000:3.0:1788510596.008822:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852713600 00000100:00100000:3.0:1788510596.008902:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:3.0:1788510596.008914:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2339:x1875388852713600:12345-192.168.201.4@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788510596.008950:0:14452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0a4c306d-b06e-474a-992e-0460ff45898c@192.168.201.4@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:3.0:1788510596.008998:0:14452:0:(genops.c:1385:class_connect()) connect: client 0a4c306d-b06e-474a-992e-0460ff45898c, cookie 0x3e734462ed66787 00000004:00100000:3.0:1788510596.009035:0:14452:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788510596.009287:0:14452:0:(import.c:65:import_set_state_nolock()) ffff92998366a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788510596.009393:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a4c306d-b06e-474a-992e-0460ff45898c+6:2339:x1875388852713600:12345-192.168.201.4@tcp:38:mount.lustre.0 Request processed in 479us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510596.009400:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:1.0:1788510596.019275:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510596.019317:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510596.019366:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510596.019495:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852714112 00000100:00100000:0.0:1788510596.019506:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852714112 00000100:00100000:0.0:1788510596.019569:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852714240 00000100:00100000:0.0:1788510596.019575:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852714240 00000100:00100000:0.0:1788510596.019601:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 3 00000100:00100000:0.0:1788510596.019614:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2340:x1875388852714112:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510596.019711:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2340:x1875388852714112:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 98us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510596.019723:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 3 00000100:00100000:0.0:1788510596.019743:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:0.0:1788510596.019749:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2340:x1875388852714240:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510596.019773:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2340:x1875388852714240:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510596.019779:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:2.0:1788510596.019977:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852713984 00000100:00100000:2.0:1788510596.019991:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852713984 00000100:00100000:2.0:1788510596.020032:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:2.0:1788510596.020039:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:2340:x1875388852713984:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510596.020075:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:2340:x1875388852713984:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 37us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510596.020082:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:1.0:1788510596.023814:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510596.024009:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852713856 00000100:00100000:3.0:1788510596.024022:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852713856 00000100:00080000:1.0:1788510596.024218:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510596.026160:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:1.0:1788510596.026192:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a4c306d-b06e-474a-992e-0460ff45898c+6:13874:x1875388852713856:12345-192.168.201.4@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788510596.027086:0:14452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788510596.027323:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a4c306d-b06e-474a-992e-0460ff45898c+6:13874:x1875388852713856:12345-192.168.201.4@tcp:41:mount.lustre.0 Request processed in 1141us (3514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510596.027335:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:2.0:1788510596.037543:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510596.037903:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852713728 00000100:00100000:1.0:1788510596.037913:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852713728 00000100:00100000:1.0:1788510596.037980:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:1.0:1788510596.037998:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a4c306d-b06e-474a-992e-0460ff45898c+6:0:x1875388852713728:12345-192.168.201.4@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788510596.038030:0:14451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788510596.038098:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a4c306d-b06e-474a-992e-0460ff45898c+6:0:x1875388852713728:12345-192.168.201.4@tcp:41:mount.lustre.0 Request processed in 101us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510596.038106:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:0.0:1788510596.047888:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510596.048001:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852714368 00000100:00100000:1.0:1788510596.048011:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852714368 00000100:00100000:1.0:1788510596.048075:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:1.0:1788510596.048086:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a4c306d-b06e-474a-992e-0460ff45898c+6:13874:x1875388852714368:12345-192.168.201.4@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788510596.048200:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a4c306d-b06e-474a-992e-0460ff45898c+6:13874:x1875388852714368:12345-192.168.201.4@tcp:40:mount.lustre.0 Request processed in 115us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510596.048208:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:3.0:1788510596.052785:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510596.052952:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852714496 00000100:00100000:0.0:1788510596.052976:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852714496 00000100:00100000:0.0:1788510596.053057:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:0.0:1788510596.053068:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2339:x1875388852714496:12345-192.168.201.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788510596.053131:0:15135:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0a4c306d-b06e-474a-992e-0460ff45898c@192.168.201.4@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:0.0:1788510596.053189:0:15135:0:(genops.c:1385:class_connect()) connect: client 0a4c306d-b06e-474a-992e-0460ff45898c, cookie 0x3e734462ed6678e 00002000:00100000:0.0:1788510596.053219:0:15135:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0a4c306d-b06e-474a-992e-0460ff45898c/ffff929aa157c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788510596.053284:0:15135:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788510596.053433:0:15135:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788510596.053467:0:15135:0:(import.c:65:import_set_state_nolock()) ffff929aa157d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788510596.053534:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a4c306d-b06e-474a-992e-0460ff45898c+6:2339:x1875388852714496:12345-192.168.201.4@tcp:8:mount.lustre.0 Request processed in 466us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510596.053542:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:0.0:1788510596.057338:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510596.057499:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852714624 00000100:00100000:3.0:1788510596.057510:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852714624 00000100:00100000:3.0:1788510596.057558:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:3.0:1788510596.057566:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2339:x1875388852714624:12345-192.168.201.4@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788510596.057600:0:15136:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0a4c306d-b06e-474a-992e-0460ff45898c@192.168.201.4@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:3.0:1788510596.057631:0:15136:0:(genops.c:1385:class_connect()) connect: client 0a4c306d-b06e-474a-992e-0460ff45898c, cookie 0x3e734462ed66795 00002000:00100000:3.0:1788510596.057642:0:15136:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0a4c306d-b06e-474a-992e-0460ff45898c/ffff929983669800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788510596.057652:0:15136:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788510596.057768:0:15136:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788510596.057801:0:15136:0:(import.c:65:import_set_state_nolock()) ffff92998366b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788510596.057868:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a4c306d-b06e-474a-992e-0460ff45898c+6:2339:x1875388852714624:12345-192.168.201.4@tcp:8:mount.lustre.0 Request processed in 301us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510596.057875:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:2.0:1788510596.061906:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510596.062020:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852714752 00000100:00100000:1.0:1788510596.062031:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852714752 00000100:00100000:1.0:1788510596.062094:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 1 00000100:00100000:1.0:1788510596.062104:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a4c306d-b06e-474a-992e-0460ff45898c+6:13874:x1875388852714752:12345-192.168.201.4@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788510596.062205:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788510596.062329:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a4c306d-b06e-474a-992e-0460ff45898c+6:13874:x1875388852714752:12345-192.168.201.4@tcp:33:mount.lustre.0 Request processed in 226us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510596.062336:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 1 00000100:00100000:1.0:1788510596.265482:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510596.265617:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852714880 00000100:00100000:2.0:1788510596.265629:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852714880 00000100:00100000:2.0:1788510596.265696:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:2.0:1788510596.265707:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a4c306d-b06e-474a-992e-0460ff45898c+6:13907:x1875388852714880:12345-192.168.201.4@tcp:101:mkdir.0 00010000:00010000:2.0:1788510596.265728:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510596.265754:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6679c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7368c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510596.265822:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510596.265836:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510596.265851:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510596.265888:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788510596.265908:0:14451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510596.265936:0:14451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510596.265971:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6679c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7368c expref: 8 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510596.265998:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7368c expref: 7 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510596.266006:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:2.0:1788510596.266009:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510596.266013:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fd000, rc 0) 00000100:00100000:2.0:1788510596.266074:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a4c306d-b06e-474a-992e-0460ff45898c+7:13907:x1875388852714880:12345-192.168.201.4@tcp:101:mkdir.0 Request processed in 369us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510596.266081:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 14 00010000:00010000:3.0:1788510596.869490:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788510597.318871:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788510597.318905:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861095936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788510597.318977:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510597.319046:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861095936 00000100:00100000:2.0:1788510597.319054:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861095936 00000100:00100000:2.0:1788510597.319109:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788510597.319118:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861095936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510597.319155:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510597.319199:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861095936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510597.319206:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788510597.319240:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510597.319285:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861095936:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788510597.386033:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0a4c306d-b06e-474a-992e-0460ff45898c 00000001:00100000:3.0:1788510597.386061:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a429815a-88fd-43fc-b7af-9ff8bdb64520 00010000:00010000:1.0:1788510597.896411:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510598.340572:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510598.340595:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861096064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788510598.340675:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510598.340946:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861096064 00000100:00100000:3.0:1788510598.340955:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861096064 00000100:00100000:3.0:1788510598.341027:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788510598.341036:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861096064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788510598.341086:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788510598.341135:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861096064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510598.341143:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788510598.341504:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788510598.341769:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788510598.341800:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861096064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510598.342344:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861096576:0@lo:400:kworker.0 00000100:00100000:0.0:1788510598.342393:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510598.342785:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788510598.342793:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3290:1875388861096192:0@lo:400:kworker.0 00000100:00100000:0.0:1788510598.342825:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510598.342860:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861096704:0@lo:400:kworker.0 00000100:00100000:0.0:1788510598.342886:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510598.342910:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861096320:0@lo:400:kworker.0 00000100:00100000:0.0:1788510598.342935:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510598.342951:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788510598.342956:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861096448:0@lo:400:kworker.0 00000100:00100000:0.0:1788510598.342975:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510598.343000:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861096576 00000100:00100000:0.0:1788510598.343007:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861096576 00000100:00100000:0.0:1788510598.343049:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861096704 00000100:00100000:0.0:1788510598.343052:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861096704 00000100:00100000:0.0:1788510598.343066:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861096448 00000100:00100000:0.0:1788510598.343069:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861096448 00000100:00100000:0.0:1788510598.343082:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788510598.343101:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861096576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510598.343148:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875388861096576:12345-0@lo:400:kworker.0 Request processed in 48us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510598.343155:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788510598.343171:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788510598.343178:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861096704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510598.343202:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875388861096704:12345-0@lo:400:kworker.0 Request processed in 25us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510598.343208:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788510598.343217:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788510598.343246:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861096448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788510598.343275:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875388861096448:12345-0@lo:400:kworker.0 Request processed in 52us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510598.343281:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788510598.343329:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875388861096448:0@lo:400:kworker.0 00000100:00100000:0.0:1788510598.343354:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3290:1875388861096704:0@lo:400:kworker.0 00000100:00100000:0.0:1788510598.343363:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3290:1875388861096576:0@lo:400:kworker.0 00000100:00100000:1.0:1788510598.343613:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861096320 00000100:00100000:1.0:1788510598.343618:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861096320 00000100:00100000:1.0:1788510598.343650:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788510598.343657:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861096320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510598.343835:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861096320:12345-0@lo:400:kworker.0 Request processed in 178us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510598.343843:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788510598.343864:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510598.343884:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861096320:0@lo:400:kworker.0 00000100:00100000:3.0:1788510598.344004:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861096192 00000100:00100000:3.0:1788510598.344008:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861096192 00000100:00100000:3.0:1788510598.344043:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788510598.344050:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:3290:x1875388861096192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510598.344088:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:3290:x1875388861096192:12345-0@lo:400:kworker.0 Request processed in 39us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510598.344095:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788510598.344126:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3290:1875388861096192:0@lo:400:kworker.0 00000001:00100000:1.0:1788510598.454864:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0a4c306d-b06e-474a-992e-0460ff45898c 00000001:00100000:1.0:1788510598.454895:0:7621:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a429815a-88fd-43fc-b7af-9ff8bdb64520 00000001:00100000:1.0:1788510598.458382:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a429815a-88fd-43fc-b7af-9ff8bdb64520 00000001:00100000:1.0:1788510598.458405:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0a4c306d-b06e-474a-992e-0460ff45898c 00000001:02000400:3.0:1788510598.882200:0:16419:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788510598.917605:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510599.941795:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510600.964695:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510601.327278:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510601.327330:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852715136 00000100:00100000:0.0:1788510601.327341:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852715136 00000100:00100000:0.0:1788510601.327419:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:0.0:1788510601.327432:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2342:x1875388852715136:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510601.327512:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2342:x1875388852715136:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510601.327530:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:0.0:1788510601.327569:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510601.327588:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852715392 00000100:00100000:0.0:1788510601.327591:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852715392 00000100:00100000:0.0:1788510601.327616:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:0.0:1788510601.327622:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+5:2342:x1875388852715392:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510601.327645:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+5:2342:x1875388852715392:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 24us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510601.327652:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:0.0:1788510601.327706:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510601.327759:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510601.327779:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510601.327788:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852715648 00000100:00100000:0.0:1788510601.327791:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852715648 00000100:00100000:0.0:1788510601.327804:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852715264 00000100:00100000:0.0:1788510601.327806:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852715264 00000100:00100000:0.0:1788510601.327817:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:0.0:1788510601.327822:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a4c306d-b06e-474a-992e-0460ff45898c+5:2342:x1875388852715648:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510601.327847:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a4c306d-b06e-474a-992e-0460ff45898c+5:2342:x1875388852715648:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 25us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510601.327853:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:0.0:1788510601.327862:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:0.0:1788510601.327867:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+5:2342:x1875388852715264:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510601.327883:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+5:2342:x1875388852715264:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 16us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510601.327897:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:0.0:1788510601.327920:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510601.327934:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852715520 00000100:00100000:0.0:1788510601.327936:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852715520 00000100:00100000:0.0:1788510601.327956:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:0.0:1788510601.327961:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a4c306d-b06e-474a-992e-0460ff45898c+6:2342:x1875388852715520:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510601.327983:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a4c306d-b06e-474a-992e-0460ff45898c+6:2342:x1875388852715520:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 22us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510601.327988:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:0.0:1788510601.328047:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510601.328058:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852715776 00000100:00100000:0.0:1788510601.328061:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852715776 00000100:00100000:0.0:1788510601.328076:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:0.0:1788510601.328081:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a4c306d-b06e-474a-992e-0460ff45898c+5:2342:x1875388852715776:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:0.0:1788510601.328100:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a4c306d-b06e-474a-992e-0460ff45898c+5:2342:x1875388852715776:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 19us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510601.328105:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:3.0:1788510601.329528:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852715008 00000100:00100000:3.0:1788510601.329543:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852715008 00000100:00100000:3.0:1788510601.329600:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 104 00000100:00100000:3.0:1788510601.329609:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:2342:x1875388852715008:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510601.329674:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:2342:x1875388852715008:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 67us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510601.329681:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 104 00000100:00080000:1.0:1788510601.330670:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788510601.330678:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788510601.330683:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788510601.989199:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788510602.365120:0:16566:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc45b00b70 20000000:00000080:1.0:1788510602.365139:0:16566:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92998367b800 uarg=0000000000000000 20000000:01000000:1.0:1788510602.365175:0:16566:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788510602.365181:0:16566:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788510602.365186:0:16566:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788510602.366147:0:16567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788510602.366595:0:16566:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788510602.379000:0:16566:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788510602.379042:0:16566:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.379065:0:16566:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a90eae000/0x3e734462ed664a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed6649a expref: 18 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.379074:0:16566:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a83032a00/0x3e734462ed664ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed664e7 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.379082:0:16566:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a90eafa00/0x3e734462ed66629 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed66622 expref: 18 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.379093:0:16566:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a813fc800/0x3e734462ed66748 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73600 expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.379102:0:16566:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff929a90eaf400/0x3e734462ed66780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73662 expref: 12 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.379136:0:16566:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.379194:0:16566:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a90eaf400/0x3e734462ed66780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73662 expref: 12 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.379209:0:16566:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a90eaf400/0x3e734462ed66780 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73662 expref: 12 pid: 14443 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510602.379686:0:16566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88311f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16566:1875388861096832:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510602.379804:0:16566:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a813fc800/0x3e734462ed66748 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73600 expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.379813:0:16566:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a813fc800/0x3e734462ed66748 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73600 expref: 12 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510602.379822:0:16566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88313480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16566:1875388861096960:192.168.201.4@tcp:104: 00010000:00010000:1.0:1788510602.379854:0:16566:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a90eafa00/0x3e734462ed66629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed66622 expref: 18 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.379862:0:16566:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a90eafa00/0x3e734462ed66629 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed66622 expref: 18 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510602.379870:0:16566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88313100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16566:1875388861097088:0@lo:104: 00000100:00100000:1.0:1788510602.379923:0:16566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788510602.379964:0:16566:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a83032a00/0x3e734462ed664ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed664e7 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.379981:0:16566:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a83032a00/0x3e734462ed664ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed664e7 expref: 18 pid: 14444 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510602.379989:0:16566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929a88311180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16566:1875388861097216:0@lo:104: 00000100:00100000:1.0:1788510602.380011:0:16566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788510602.380030:0:16566:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff929a90eae000/0x3e734462ed664a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e734462ed6649a expref: 18 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510602.380037:0:16566:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff929a90eae000/0x3e734462ed664a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e734462ed6649a expref: 18 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510602.380044:0:16566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16566:1875388861097344:0@lo:104: 00000100:00100000:1.0:1788510602.380068:0:16566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510602.380078:0:16566:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788510602.380598:0:14435:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788510602.380614:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861097088 00000100:00100000:0.0:1788510602.380622:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861097088 00000100:00100000:0.0:1788510602.380662:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861097216 00000100:00100000:0.0:1788510602.380665:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861097216 00000100:00100000:0.0:1788510602.380675:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861097344 00000100:00100000:0.0:1788510602.380678:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861097344 00000100:00100000:0.0:1788510602.380692:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788510602.380708:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+5:16566:x1875388861097088:12345-0@lo:104: 00010000:00010000:0.0:1788510602.380724:0:14435:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.380809:0:14435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788510602.380816:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+5:16566:x1875388861097088:12345-0@lo:104: Request processed in 109us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510602.380824:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788510602.380855:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788510602.380863:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+4:16566:x1875388861097216:12345-0@lo:104: 00010000:00010000:0.0:1788510602.380881:0:14435:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.380917:0:14435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788510602.380923:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+4:16566:x1875388861097216:12345-0@lo:104: Request processed in 62us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510602.380929:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788510602.380942:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788510602.380948:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+3:16566:x1875388861097344:12345-0@lo:104: 00010000:00010000:0.0:1788510602.380956:0:14435:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.380988:0:14435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788510602.380992:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+3:16566:x1875388861097344:12345-0@lo:104: Request processed in 45us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510602.380998:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788510602.381044:0:16132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788510602.381057:0:16132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381064:0:16132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fce00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:0.0:1788510602.381068:0:16132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381077:0:16132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788510602.381085:0:16132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510602.381091:0:16132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788510602.381123:0:16132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381131:0:16132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788510602.381152:0:16132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381159:0:16132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed66622 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed66629 expref: -99 pid: 15855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381171:0:16132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788510602.381175:0:16132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381181:0:16132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf000 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:0.0:1788510602.381184:0:16132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381203:0:16132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788510602.381210:0:16132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510602.381215:0:16132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788510602.381437:0:16132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381444:0:16132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788510602.381452:0:16132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381459:0:16132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929a90eaf000/0x3e734462ed664e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed664ee expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381470:0:16132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788510602.381473:0:16132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381479:0:16132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76e00 already unused, calling callback (ffffffffc1b70c20) 10000000:00010000:0.0:1788510602.381482:0:16132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381489:0:16132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788510602.381496:0:16132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788510602.381508:0:16132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788510602.381523:0:16132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381529:0:16132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788510602.381548:0:16132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381555:0:16132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.104@tcp lock: ffff929aaec76e00/0x3e734462ed6649a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e734462ed664a1 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.381568:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510602.381570:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510602.381572:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510602.381596:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861097472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788510602.381631:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510602.381668:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788510602.381675:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861097600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788510602.381696:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510602.381723:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788510602.381731:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3291:1875388861097728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788510602.381758:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510602.381802:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861097472 00000100:00100000:0.0:1788510602.381807:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861097472 00010000:00010000:0.0:1788510602.381830:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a90eafa00/0x3e734462ed66629 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed66622 expref: 19 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510602.382153:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861097600 00000100:00100000:0.0:1788510602.382164:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861097600 00010000:00010000:0.0:1788510602.382181:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a83032a00/0x3e734462ed664ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed664e7 expref: 20 pid: 14444 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510602.382195:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861097728 00000100:00100000:0.0:1788510602.382198:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861097728 00010000:00010000:0.0:1788510602.382207:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a90eae000/0x3e734462ed664a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6649a expref: 21 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510602.382629:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510602.382639:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788510602.382678:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788510602.382696:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+21:3288:x1875388861097472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788510602.382712:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510602.382719:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a90eafa00/0x3e734462ed66629 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed66622 expref: 21 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.382732:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a90eafa00/0x3e734462ed66629 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed66622 expref: 21 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.382756:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510602.382867:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+21:3288:x1875388861097472:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510602.382883:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788510602.382908:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788510602.382915:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+20:3288:x1875388861097600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788510602.382936:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510602.382942:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a83032a00/0x3e734462ed664ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed664e7 expref: 20 pid: 14444 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.382951:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a83032a00/0x3e734462ed664ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed664e7 expref: 20 pid: 14444 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.382972:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510602.382994:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+20:3288:x1875388861097600:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510602.383001:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788510602.383013:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788510602.383018:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:3291:x1875388861097728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788510602.383025:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510602.383030:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a90eae000/0x3e734462ed664a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e734462ed6649a expref: 19 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.383038:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a90eae000/0x3e734462ed664a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e734462ed6649a expref: 19 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510602.383046:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510602.383073:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:3291:x1875388861097728:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510602.383079:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788510602.383169:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3291:1875388861097728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788510602.383767:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861097472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788510602.383783:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861097600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788510602.383808:0:16566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a90eafa00/0x3e734462ed66629 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed66622 expref: 18 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510602.383822:0:16566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88313100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16566:1875388861097088:0@lo:104: 00010000:00010000:1.0:1788510602.383833:0:16566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83032a00/0x3e734462ed664ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed664e7 expref: 17 pid: 14444 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510602.383841:0:16566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88311180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16566:1875388861097216:0@lo:104: 00010000:00010000:1.0:1788510602.383850:0:16566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a90eae000/0x3e734462ed664a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e734462ed6649a expref: 16 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510602.383857:0:16566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16566:1875388861097344:0@lo:104: 00000100:00100000:1.0:1788510602.389819:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510602.389908:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510602.390050:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852715904 00000100:00100000:3.0:1788510602.390061:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852715904 00010000:00010000:3.0:1788510602.390107:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a90eaf400/0x3e734462ed66780 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73662 expref: 13 pid: 14443 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510602.390167:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852716032 00000100:00100000:3.0:1788510602.390170:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852716032 00010000:00010000:3.0:1788510602.390182:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff929a813fc800/0x3e734462ed66748 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73600 expref: 14 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510602.390195:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:3.0:1788510602.390204:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+14:2340:x1875388852715904:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510602.390218:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510602.390373:0:14438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a90eaf400/0x3e734462ed66780 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73662 expref: 14 pid: 14443 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.390385:0:14438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a90eaf400/0x3e734462ed66780 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73662 expref: 14 pid: 14443 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.390407:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510602.390458:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+14:2340:x1875388852715904:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 254us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510602.390465:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:3.0:1788510602.390483:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:3.0:1788510602.390490:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:2340:x1875388852716032:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510602.390499:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510602.390503:0:14438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff929a813fc800/0x3e734462ed66748 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73600 expref: 13 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.390511:0:14438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff929a813fc800/0x3e734462ed66748 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73600 expref: 13 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.390531:0:14438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.390540:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.390556:0:14438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.390563:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.390570:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.390577:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.390584:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510602.391609:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.391623:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.391635:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510602.391649:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510602.391689:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:2340:x1875388852716032:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 1196us (1777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510602.391708:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 8 00010000:00010000:2.0:1788510602.394004:0:16566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a90eaf400/0x3e734462ed66780 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73662 expref: 12 pid: 14443 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510602.394030:0:16566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88311f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16566:1875388861096832:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510602.394042:0:16566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a813fc800/0x3e734462ed66748 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73600 expref: 11 pid: 14446 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510602.394050:0:16566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929a88313480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16566:1875388861096960:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510602.394088:0:16566:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510602.394097:0:16566:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510602.394104:0:16566:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510602.394110:0:16566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff929a83032400/0x3e734462ed667aa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510602.447107:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861097856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788510602.447206:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510602.449007:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861097856 00000100:00100000:2.0:1788510602.449026:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861097856 00000100:00100000:2.0:1788510602.449125:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788510602.449153:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861097856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788510602.449201:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788510602.449258:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510602.449306:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861097856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510602.449313:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788510602.449374:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861097856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788510603.012499:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788510603.338728:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788510603.460725:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861098112:0@lo:400:kworker.0 00000100:00100000:3.0:1788510603.460789:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861098240:0@lo:400:kworker.0 00000100:00100000:2.0:1788510603.460793:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861097984:0@lo:400:kworker.0 00000100:00100000:1.0:1788510603.460822:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510603.460856:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510603.460856:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510603.460890:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861098624:0@lo:400:kworker.0 00000100:00100000:2.0:1788510603.460914:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861098496:0@lo:400:kworker.0 00000100:00100000:3.0:1788510603.460915:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788510603.460926:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861098368:0@lo:400:kworker.0 00000100:00100000:1.0:1788510603.460933:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510603.460954:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510603.460973:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861098112 00000100:00100000:3.0:1788510603.460982:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861098112 00000100:00100000:1.0:1788510603.460983:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861098240 00000100:00100000:1.0:1788510603.460989:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861098240 00000100:00100000:2.0:1788510603.461005:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861097984 00000100:00100000:2.0:1788510603.461011:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861097984 00000100:00100000:1.0:1788510603.461041:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788510603.461049:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788510603.461054:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861098240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510603.461062:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab4b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:3288:x1875388861097984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510603.461110:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861098240:12345-0@lo:400:kworker.0 Request processed in 59us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510603.461118:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab4b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:3288:x1875388861097984:12345-0@lo:400:kworker.0 Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510603.461118:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788510603.461129:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788510603.461151:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861098624 00000100:00100000:1.0:1788510603.461155:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861098624 00000100:00100000:2.0:1788510603.461161:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861098496 00000100:00100000:3.0:1788510603.461163:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788510603.461165:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861098496 00000100:00100000:3.0:1788510603.461171:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861098112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510603.461192:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788510603.461199:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788510603.461204:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861098624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788510603.461210:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861098496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510603.461240:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875388861098112:12345-0@lo:400:kworker.0 Request processed in 42us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.461247:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788510603.461275:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875388861098624:12345-0@lo:400:kworker.0 Request processed in 75us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.461282:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510603.461283:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861098496:12345-0@lo:400:kworker.0 Request processed in 77us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510603.461286:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788510603.461295:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788510603.461305:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861098368 00000100:00100000:1.0:1788510603.461310:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861098368 00000100:00100000:3.0:1788510603.461317:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861098240:0@lo:400:kworker.0 00000100:00100000:2.0:1788510603.461328:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861097984:0@lo:400:kworker.0 00000100:00100000:1.0:1788510603.461341:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788510603.461343:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861098496:0@lo:400:kworker.0 00000100:00100000:1.0:1788510603.461350:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861098368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788510603.461389:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861098112:0@lo:400:kworker.0 00000100:00100000:3.0:1788510603.461402:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3289:1875388861098624:0@lo:400:kworker.0 00000100:00100000:1.0:1788510603.461408:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875388861098368:12345-0@lo:400:kworker.0 Request processed in 58us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510603.461415:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788510603.461425:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875388861098368:0@lo:400:kworker.0 00000100:00080000:1.0:1788510603.461436:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788510603.461442:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788510603.462130:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510603.462145:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861098752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788510603.462186:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510603.462457:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861098752 00000100:00100000:2.0:1788510603.462463:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861098752 00000100:00100000:2.0:1788510603.463354:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788510603.463370:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861098752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788510603.463405:0:15139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788510603.463473:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861098752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510603.463494:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788510603.463528:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861098752:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788510603.529959:0:14448:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788510603.529966:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9299810a7800 from 10 10000000:01000000:2.0:1788510603.529971:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788510603.530030:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed667b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510603.530043:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed667b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510603.530056:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed667b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510603.530086:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861098880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788510603.530768:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510603.534380:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929abaa1f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788510603.543062:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861098880 00000100:00100000:3.0:1788510603.543085:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861098880 00000100:00100000:3.0:1788510603.543169:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788510603.543180:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+16:14448:x1875388861098880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788510603.543200:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510603.543377:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929ab4a68a00/0x3e734462ed667b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed667b1 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.543409:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929ab4a68a00/0x3e734462ed667b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed667b1 expref: 17 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.543436:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929ab4a68a00/0x3e734462ed667b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed667b1 expref: 17 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.543446:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68a00, rc 0) 00000100:00100000:3.0:1788510603.543603:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:14448:x1875388861098880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 424us (12836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.543612:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788510603.547043:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861098880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510603.547075:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed667b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed667b8 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510603.547089:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed667b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed667b8 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510603.547176:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510603.547477:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510603.549064:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a857c3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788510603.550721:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861099008 00000100:00100000:3.0:1788510603.550733:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861099008 00000100:00100000:3.0:1788510603.550788:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788510603.550798:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:14448:x1875388861099008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510603.551446:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:14448:x1875388861099008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 648us (3967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.551456:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788510603.551575:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788510603.551634:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510603.551683:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510603.551716:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7c700c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510603.555629:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861099136 00000100:00100000:3.0:1788510603.555644:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861099136 00000100:00100000:3.0:1788510603.555715:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788510603.555726:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:14448:x1875388861099136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788510603.555999:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:14448:x1875388861099136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (4315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.556007:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788510603.556078:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788510603.556845:0:16604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788510603.556903:0:14448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788510603.556921:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788510603.556939:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed667b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed667b8 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.556950:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929a813fce00/0x3e734462ed667b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed667b8 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510603.556961:0:14448:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788510603.556963:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929981eab000 from 10 10000000:01000000:3.0:1788510603.556966:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788510603.556997:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a68c00/0x3e734462ed667bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.557005:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929ab4a68c00/0x3e734462ed667bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.557015:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929ab4a68c00/0x3e734462ed667bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510603.557037:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788510603.557082:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510603.557114:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8bd526c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510603.557130:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861099264 00000100:00100000:3.0:1788510603.557134:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861099264 00000100:00100000:3.0:1788510603.557166:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788510603.557173:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+17:14448:x1875388861099264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788510603.557184:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510603.557194:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929ab4a68400/0x3e734462ed667c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed667bf expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.557247:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929ab4a68400/0x3e734462ed667c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed667bf expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.557265:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929ab4a68400/0x3e734462ed667c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed667bf expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.557275:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a68400, rc 0) 00000100:00100000:3.0:1788510603.557306:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:14448:x1875388861099264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.557312:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788510603.557345:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788510603.557357:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929ab4a68c00/0x3e734462ed667bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed667c6 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.557366:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929ab4a68c00/0x3e734462ed667bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed667c6 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510603.557409:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510603.557433:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510603.557446:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8bd526c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510603.557456:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861099392 00000100:00100000:3.0:1788510603.557460:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861099392 00000100:00100000:3.0:1788510603.557480:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788510603.557486:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:14448:x1875388861099392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510603.557711:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:14448:x1875388861099392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.557718:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788510603.557749:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510603.557784:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788510603.557819:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510603.557832:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8bd526c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510603.557843:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861099520 00000100:00100000:3.0:1788510603.557846:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861099520 00000100:00100000:3.0:1788510603.557866:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788510603.557872:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:14448:x1875388861099520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788510603.557991:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:14448:x1875388861099520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.557999:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788510603.558034:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788510603.567159:0:16605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788510603.567541:0:14448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788510603.567574:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788510603.567590:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a68c00/0x3e734462ed667bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed667c6 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.567604:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929ab4a68c00/0x3e734462ed667bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed667c6 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788510603.567615:0:14448:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788510603.567618:0:14448:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff929aaeb69800 from 10 10000000:01000000:3.0:1788510603.567621:0:14448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788510603.567671:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69c00/0x3e734462ed667cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.567680:0:14448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.104@tcp lock: ffff929ab4a69c00/0x3e734462ed667cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.567713:0:14448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.104@tcp lock: ffff929ab4a69c00/0x3e734462ed667cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510603.567745:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788510603.567823:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788510603.567887:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a8bd526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510603.567987:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861099648 00000100:00100000:0.0:1788510603.567997:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861099648 00000100:00100000:0.0:1788510603.568057:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788510603.568069:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+18:14448:x1875388861099648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788510603.568085:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510603.568101:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929a90eae000/0x3e734462ed667d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e734462ed667cd expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510603.568127:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929a90eae000/0x3e734462ed667d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e734462ed667cd expref: 19 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510603.568138:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929a90eae000/0x3e734462ed667d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e734462ed667cd expref: 19 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510603.568147:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae000, rc 0) 00000100:00100000:0.0:1788510603.568202:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:14448:x1875388861099648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510603.568241:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788510603.568819:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788510603.568836:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.104@tcp lock: ffff929ab4a69c00/0x3e734462ed667cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed667d4 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510603.568846:0:14448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.104@tcp lock: ffff929ab4a69c00/0x3e734462ed667cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e734462ed667d4 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510603.568968:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510603.569003:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510603.569069:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510603.575510:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861099776 00000100:00100000:3.0:1788510603.575526:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861099776 00000100:00100000:3.0:1788510603.579625:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788510603.579661:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:14448:x1875388861099776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510603.580077:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:14448:x1875388861099776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 434us (11071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.580086:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788510603.580201:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788510603.580315:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510603.580381:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510603.586083:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a9813d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788510603.589527:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861099904 00000100:00100000:0.0:1788510603.589543:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861099904 00000100:00100000:0.0:1788510603.589606:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788510603.589617:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:14448:x1875388861099904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788510603.590018:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:14448:x1875388861099904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 402us (9638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510603.590027:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788510603.591046:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4d56e3b-8589-453f-93c5-42174bfbbc5c:14448:1875388861099904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788510603.593804:0:16607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788510603.596043:0:14448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788510603.596091:0:14448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788510603.596108:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.104@tcp lock: ffff929ab4a69c00/0x3e734462ed667cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed667d4 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.596123:0:14448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.104@tcp lock: ffff929ab4a69c00/0x3e734462ed667cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e734462ed667d4 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510603.748339:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510603.748391:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852716160 00000100:00100000:3.0:1788510603.748401:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852716160 00000100:00100000:3.0:1788510603.748460:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 115 00000100:00100000:3.0:1788510603.748470:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+11:13761:x1875388852716160:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788510603.748486:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510603.748514:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929ab4a69600/0x3e734462ed667db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73693 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.748543:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929ab4a69600/0x3e734462ed667db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73693 expref: 12 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.748555:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929ab4a69600/0x3e734462ed667db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73693 expref: 12 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.748564:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69600, rc 0) 00000100:00100000:3.0:1788510603.748621:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+12:13761:x1875388852716160:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 Request processed in 152us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.748628:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 115 00000100:00100000:3.0:1788510603.755452:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510603.755492:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852716288 00000100:00100000:3.0:1788510603.755503:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852716288 00000100:00100000:3.0:1788510603.755560:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 116 00000100:00100000:3.0:1788510603.755573:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+12:13761:x1875388852716288:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788510603.755866:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+12:13761:x1875388852716288:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 Request processed in 295us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.755875:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 116 00000100:00100000:3.0:1788510603.759864:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510603.766418:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852716416 00000100:00100000:2.0:1788510603.766433:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852716416 00000100:00100000:2.0:1788510603.766485:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 117 00000100:00100000:2.0:1788510603.766495:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+12:13761:x1875388852716416:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788510603.766721:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+12:13761:x1875388852716416:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 Request processed in 226us (6867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510603.766729:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 117 00000100:00100000:1.0:1788510603.791496:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510603.791750:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852716544 00000100:00100000:3.0:1788510603.791760:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852716544 00000100:00100000:3.0:1788510603.791818:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 118 00000100:00100000:3.0:1788510603.791837:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+12:13761:x1875388852716544:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788510603.791853:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510603.791881:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff929ab4a69800/0x3e734462ed667e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7369a expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.791910:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff929ab4a69800/0x3e734462ed667e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7369a expref: 13 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.791923:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff929ab4a69800/0x3e734462ed667e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7369a expref: 13 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510603.791933:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69800, rc 0) 00000100:00100000:3.0:1788510603.791985:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13761:x1875388852716544:12345-192.168.201.4@tcp:101:ll_cfg_requeue.0 Request processed in 150us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510603.791993:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 118 00000100:00100000:3.0:1788510603.810186:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510603.810268:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852716672 00000100:00100000:0.0:1788510603.810292:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852716672 00000100:00100000:0.0:1788510603.810369:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 119 00000100:00100000:0.0:1788510603.810383:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13761:x1875388852716672:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788510603.811899:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13761:x1875388852716672:12345-192.168.201.4@tcp:501:ll_cfg_requeue.0 Request processed in 1512us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510603.811912:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 119 00000100:00100000:3.0:1788510603.818858:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510603.818920:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852716800 00000100:00100000:1.0:1788510603.818932:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852716800 00000100:00100000:1.0:1788510603.818995:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 120 00000100:00100000:1.0:1788510603.819006:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a90fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13761:x1875388852716800:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788510603.819274:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a90fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:13761:x1875388852716800:12345-192.168.201.4@tcp:503:ll_cfg_requeue.0 Request processed in 269us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510603.819283:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 120 00010000:00010000:2.0:1788510604.036498:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788510605.061364:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510606.085927:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788510606.443320:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510606.443379:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510606.443410:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510606.443445:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852717312 00000100:00100000:1.0:1788510606.443457:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510606.443460:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852717312 00000100:00100000:1.0:1788510606.443486:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510606.443510:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510606.443523:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852717568 00000100:00100000:0.0:1788510606.443528:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852717568 00000100:00100000:1.0:1788510606.443543:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510606.443548:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852717184 00000100:00100000:0.0:1788510606.443552:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852717184 00000100:00100000:0.0:1788510606.443566:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852717696 00000100:00100000:0.0:1788510606.443569:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852717696 00000100:00100000:0.0:1788510606.443585:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:0.0:1788510606.443595:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+5:2341:x1875388852717312:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:2.0:1788510606.443617:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852717056 00000100:00100000:2.0:1788510606.443623:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852717056 00000100:00100000:2.0:1788510606.443657:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852717440 00000100:00100000:2.0:1788510606.443660:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852717440 00000100:00100000:2.0:1788510606.443684:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 25 00000100:00080000:1.0:1788510606.443686:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788510606.443690:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510606.443691:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2341:x1875388852717056:12345-192.168.201.4@tcp:400:kworker.0 00000100:00080000:1.0:1788510606.443693:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788510606.443706:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 26 00000100:00100000:1.0:1788510606.443713:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a4c306d-b06e-474a-992e-0460ff45898c+6:2341:x1875388852717440:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510606.443735:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788510606.443746:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2341:x1875388852717056:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 55us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510606.443755:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 25 00000100:00100000:2.0:1788510606.443781:0:15136:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788510606.443788:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788510606.443792:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:2.0:1788510606.443800:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a4c306d-b06e-474a-992e-0460ff45898c+5:2341:x1875388852717568:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510606.450040:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a4c306d-b06e-474a-992e-0460ff45898c+6:2341:x1875388852717440:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 6312us (6514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510606.450135:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 26 00000100:00100000:1.0:1788510606.450386:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852716928 00000100:00100000:1.0:1788510606.450398:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852716928 00000100:00100000:1.0:1788510606.450656:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 121 00000100:00100000:1.0:1788510606.450665:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:2341:x1875388852716928:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510606.450732:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:2341:x1875388852716928:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 68us (7275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510606.451544:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 121 00000100:00100000:1.0:1788510606.455042:0:16680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788510606.456273:0:16680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788510606.457519:0:16680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:1.0:1788510606.457546:0:16680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+5:2341:x1875388852717184:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510606.458047:0:16680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+5:2341:x1875388852717184:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 512us (14558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510606.458999:0:16680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:1.0:1788510606.459041:0:16680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788510606.459531:0:16680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:1.0:1788510606.459870:0:16680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a4c306d-b06e-474a-992e-0460ff45898c+5:2341:x1875388852717696:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510606.460767:0:16680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a4c306d-b06e-474a-992e-0460ff45898c+5:2341:x1875388852717696:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 1219us (17218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510606.461864:0:16680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:0.0:1788510606.462358:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+5:2341:x1875388852717312:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 18760us (18975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510606.462369:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:2.0:1788510606.485234:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a4c306d-b06e-474a-992e-0460ff45898c+5:2341:x1875388852717568:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 41404us (41793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510606.485250:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:1.0:1788510606.726993:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510606.727173:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852717824 00000100:00100000:2.0:1788510606.727200:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852717824 00000100:00100000:2.0:1788510606.727305:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:2.0:1788510606.727318:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:14417:x1875388852717824:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788510606.727344:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510606.727373:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed667e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736a1 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.727458:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed667f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.727476:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed667f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.727492:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed667f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.727509:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed667f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.727517:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed667f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.727524:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed667f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.727895:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed667fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.727905:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed667fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.727914:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed667fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510606.727962:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788510606.727967:0:14452:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510606.728005:0:14452:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed667fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728017:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed667f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728024:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed667f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728032:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed667f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728038:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510606.728042:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed667f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728051:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed667f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728064:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:2.0:1788510606.728067:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510606.728073:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed667f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728080:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed667f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728095:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed667f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728111:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed667f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728118:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed667f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728123:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510606.728126:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed667f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728132:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed667f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728141:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff929a8831a400) 00010000:00010000:2.0:1788510606.728144:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510606.728147:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed667f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728153:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed667f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728204:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed667e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736a1 expref: 8 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728217:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc000/0x3e734462ed667fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736a1 expref: 7 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.728277:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff929a8831af00) 00010000:00010000:2.0:1788510606.728281:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510606.728291:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fc000, rc 0) 00000100:00100000:2.0:1788510606.728371:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:14417:x1875388852717824:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 1053us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510606.728379:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:3.0:1788510606.733387:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510606.733549:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852718080 00000100:00100000:1.0:1788510606.733560:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852718080 00000100:00100000:1.0:1788510606.733629:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:1.0:1788510606.733639:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:14417:x1875388852718080:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788510606.733660:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510606.733684:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed66805 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736a8 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.733891:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6680c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.733906:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6680c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.733918:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6680c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.734169:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed66813 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.734179:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed66813 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.734187:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed66813 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735096:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed6681a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735108:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed6681a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735117:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed6681a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510606.735128:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788510606.735586:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6680c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735595:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6680c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735608:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6680c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735614:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510606.735619:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6680c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735627:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6680c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735638:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff929a8831af00) 00010000:00010000:1.0:1788510606.735641:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510606.735645:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6680c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735651:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed6680c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735674:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed66813 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735681:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed66813 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735687:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed66813 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735691:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510606.735694:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed66813 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735709:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed66813 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735716:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff929a85fa0d00) 00010000:00010000:1.0:1788510606.735718:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510606.735721:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed66813 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.735727:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed66813 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.736183:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed66805 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736a8 expref: 10 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.736198:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032200/0x3e734462ed6681a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736a8 expref: 9 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.736206:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a85fa0c00) 00010000:00010000:1.0:1788510606.736208:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510606.736211:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032200, rc 0) 00000100:00100000:1.0:1788510606.736316:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:14417:x1875388852718080:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 2678us (2938us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788510606.736325:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:3.0:1788510606.744977:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510606.745209:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852718208 00000100:00100000:2.0:1788510606.745250:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852718208 00000100:00100000:2.0:1788510606.745317:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:2.0:1788510606.745327:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:14417:x1875388852718208:12345-192.168.201.4@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788510606.745611:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:14417:x1875388852718208:12345-192.168.201.4@tcp:59:lhsmtool_posix.0 Request processed in 284us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510606.745619:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:3.0:1788510606.805199:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510606.805331:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852718336 00000100:00100000:2.0:1788510606.805342:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852718336 00000100:00100000:2.0:1788510606.805407:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:2.0:1788510606.805418:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:14423:x1875388852718336:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510606.805437:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510606.805458:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed66828 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736af expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805522:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6682f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805537:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6682f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805562:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6682f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805579:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66836 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805602:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805610:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805824:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6682f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805832:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6682f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805839:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6682f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805844:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510606.805849:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6682f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805856:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6682f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805868:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:2.0:1788510606.805871:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510606.805876:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6682f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805882:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed6682f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805893:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805905:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66836 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805912:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66836 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805917:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fd400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510606.805920:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66836 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805927:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66836 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805934:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff929a8831a400) 00010000:00010000:2.0:1788510606.805936:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510606.805939:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66836 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805945:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66836 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805976:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed66828 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736af expref: 10 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.805986:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:2.0:1788510606.805988:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510606.805992:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed66828 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736af expref: 10 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.806000:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fc800, rc 0) 00000100:00100000:2.0:1788510606.807431:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:14423:x1875388852718336:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 2007us (2288us total) trans 0 rc 301/301 00000100:00100000:2.0:1788510606.807442:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:3.0:1788510606.812070:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510606.812162:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852718464 00000100:00100000:0.0:1788510606.812177:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852718464 00000100:00100000:0.0:1788510606.812263:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:0.0:1788510606.812276:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:14423:x1875388852718464:12345-192.168.201.4@tcp:700:lfs.0 00000100:00100000:0.0:1788510606.812367:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:14423:x1875388852718464:12345-192.168.201.4@tcp:700:lfs.0 Request processed in 93us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510606.812376:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:3.0:1788510606.814750:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510606.814970:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852718720 00000100:00100000:1.0:1788510606.814980:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852718720 00000100:00100000:1.0:1788510606.815069:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:1.0:1788510606.815081:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:14423:x1875388852718720:12345-192.168.201.4@tcp:36:lfs.0 00010000:00010000:1.0:1788510606.815175:0:16328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510606.815210:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a68600/0x3e734462ed6676b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7362a expref: 9 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.815322:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:1.0:1788510606.815328:0:16328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788510606.815551:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.815566:0:16328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7368c expref: 5 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.815576:0:16328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.815611:0:16328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7368c expref: 5 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.815627:0:16328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7368c expref: 5 pid: 14451 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510606.815711:0:16328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae949880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16328:1875388861100032:192.168.201.4@tcp:104: 00000100:00100000:1.0:1788510606.815933:0:16328:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a89466540 going to sleep for 11 seconds 00000100:00100000:3.0:1788510606.818997:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510606.819031:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852718848 00000100:00100000:3.0:1788510606.819040:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852718848 00000100:00100000:0.0:1788510606.819072:0:16328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae949880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16328:1875388861100032:192.168.201.4@tcp:104: 00010000:00010000:3.0:1788510606.819085:0:14436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7368c expref: 6 pid: 14451 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510606.819102:0:16328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510606.819123:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:3.0:1788510606.819134:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a4c306d-b06e-474a-992e-0460ff45898c+6:2340:x1875388852718848:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510606.819902:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510606.819911:0:14436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7368c expref: 6 pid: 14451 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.819926:0:14436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7368c expref: 6 pid: 14451 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.819949:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed667a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7368c expref: 6 pid: 14451 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.819965:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:3.0:1788510606.819969:0:14436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.819978:0:14436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.819985:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.820070:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510606.820132:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a4c306d-b06e-474a-992e-0460ff45898c+5:2340:x1875388852718848:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 998us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510606.820162:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 9 00010000:00010000:0.0:1788510606.823829:0:16328:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510606.823851:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510606.823894:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed66844 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510606.823908:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed66844 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510606.823921:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed66844 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510606.825378:0:16328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788510606.825393:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510606.825402:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510606.825409:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510606.825415:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510606.825419:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510606.825438:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510606.825452:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a83eabe00) 00010000:00010000:0.0:1788510606.825455:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510606.825459:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510606.825466:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed6683d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510606.825486:0:16328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c1b6d10 reply state 00000000650dd53f transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed66844 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510606.825493:0:16328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788510606.825597:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+10:14423:x1875388852718720:12345-192.168.201.4@tcp:36:lfs.0 Request processed in 10513us (10851us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788510606.825607:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 19 00010000:00010000:3.0:1788510606.830414:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed66844 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.830438:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed66844 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.830468:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed66844 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.830476:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaec00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510606.830481:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed66844 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.830492:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed66844 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.830514:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff929a8b8f5c00) 00010000:00010000:3.0:1788510606.830517:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510606.830524:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed66844 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510606.830531:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed66844 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510606.913311:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510606.913452:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852718976 00000100:00100000:2.0:1788510606.913462:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852718976 00000100:00100000:2.0:1788510606.913525:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:2.0:1788510606.913534:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:14431:x1875388852718976:12345-192.168.201.4@tcp:101:lctl.0 00010000:00010000:2.0:1788510606.913560:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510606.913583:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6684b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736b6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.913660:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66852 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.913672:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.913680:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510606.913711:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788510606.913714:0:14451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510606.913746:0:14451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.913773:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed6684b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736b6 expref: 11 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.913800:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd400/0x3e734462ed66852 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736b6 expref: 10 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.913822:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8831a400) 00010000:00010000:2.0:1788510606.913825:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510606.913827:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fd400, rc 0) 00000100:00100000:2.0:1788510606.913875:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+10:14431:x1875388852718976:12345-192.168.201.4@tcp:101:lctl.0 Request processed in 342us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510606.913880:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:1.0:1788510606.931419:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510606.931726:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852719104 00000100:00100000:2.0:1788510606.931738:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852719104 00000100:00100000:2.0:1788510606.931835:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:2.0:1788510606.931846:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a4c306d-b06e-474a-992e-0460ff45898c+5:14432:x1875388852719104:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510606.931866:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510606.931886:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed66859 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736bd expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.931955:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed66860 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.931969:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed66860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.931982:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed66860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510606.932017:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788510606.932022:0:14452:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510606.932043:0:14452:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed66860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.932076:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc800/0x3e734462ed66859 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736bd expref: 7 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.932088:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd600/0x3e734462ed66860 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736bd expref: 6 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.932094:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8831a400) 00010000:00010000:2.0:1788510606.932096:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510606.932099:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a813fd600, rc 0) 00000100:00100000:2.0:1788510606.932169:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a4c306d-b06e-474a-992e-0460ff45898c+6:14432:x1875388852719104:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 325us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510606.932176:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:3.0:1788510606.933922:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510606.933986:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852719232 00000100:00100000:2.0:1788510606.933994:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852719232 00000100:00100000:2.0:1788510606.934054:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:2.0:1788510606.934066:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a4c306d-b06e-474a-992e-0460ff45898c+6:14432:x1875388852719232:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510606.934084:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510606.934100:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed66867 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736c4 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934165:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc600/0x3e734462ed6686e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934178:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc600/0x3e734462ed6686e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934190:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc600/0x3e734462ed6686e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934214:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66875 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934219:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934252:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934337:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed6687c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934342:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed6687c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934346:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed6687c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510606.934371:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788510606.934373:0:14451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510606.934387:0:14451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed6687c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934396:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc600/0x3e734462ed6686e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934400:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc600/0x3e734462ed6686e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934405:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc600/0x3e734462ed6686e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934416:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a813fc600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510606.934419:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc600/0x3e734462ed6686e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934424:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc600/0x3e734462ed6686e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934433:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8831a400) 00010000:00010000:2.0:1788510606.934434:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510606.934438:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc600/0x3e734462ed6686e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934442:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fc600/0x3e734462ed6686e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934451:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934455:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66875 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934458:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66875 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934461:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510606.934463:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66875 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934466:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66875 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934475:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff929a8831a800) 00010000:00010000:2.0:1788510606.934477:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510606.934479:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66875 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934482:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66875 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934506:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a813fd000/0x3e734462ed66867 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736c4 expref: 8 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934515:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed6687c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736c4 expref: 7 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.934519:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff929a8831a900) 00010000:00010000:2.0:1788510606.934520:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788510606.934522:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77e00, rc 0) 00000100:00100000:2.0:1788510606.934583:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a4c306d-b06e-474a-992e-0460ff45898c+7:14432:x1875388852719232:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 520us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510606.934588:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 22 00000100:00100000:1.0:1788510606.940489:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510606.940659:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852719488 00000100:00100000:2.0:1788510606.940676:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852719488 00000100:00100000:1.0:1788510606.940921:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 23 00000100:00100000:1.0:1788510606.940936:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a4c306d-b06e-474a-992e-0460ff45898c+7:14432:x1875388852719488:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510606.940986:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510606.941032:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736cb expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510606.941148:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788510606.941351:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66883 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736cb expref: 9 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.941370:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8831a400) 00010000:00010000:1.0:1788510606.941374:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788510606.941380:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032000/0x3e734462ed66883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736cb expref: 9 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.941397:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032000, rc 0) 00000100:00100000:1.0:1788510606.941478:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a4c306d-b06e-474a-992e-0460ff45898c+8:14432:x1875388852719488:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 545us (1003us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788510606.941485:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 23 00000100:00100000:0.0:1788510606.947643:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510606.947762:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852719744 00000100:00100000:2.0:1788510606.947774:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852719744 00000100:00100000:2.0:1788510606.947850:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 24 00000100:00100000:2.0:1788510606.947862:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a4c306d-b06e-474a-992e-0460ff45898c+8:14432:x1875388852719744:12345-192.168.201.4@tcp:36:lfs.0 00010000:00010000:2.0:1788510606.947923:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510606.947963:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed6687c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736c4 expref: 8 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.947981:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff929a8831a900) 00010000:00010000:2.0:1788510606.948003:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788510606.948030:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66891 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.948043:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.948053:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788510606.948704:0:14451:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ea4fa3f reply state 000000005d3086dc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510606.948716:0:14451:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788510606.948725:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788510606.948965:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a4c306d-b06e-474a-992e-0460ff45898c+9:14432:x1875388852719744:12345-192.168.201.4@tcp:36:lfs.0 Request processed in 1103us (1346us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788510606.948974:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 24 00000100:00100000:3.0:1788510606.956695:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510606.956845:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852720000 00000100:00100000:2.0:1788510606.956861:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852720000 00010000:00010000:1.0:1788510606.956918:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510606.956928:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 2 00010000:00010000:1.0:1788510606.956931:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66891 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510606.956938:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a4c306d-b06e-474a-992e-0460ff45898c+9:14432:x1875388852720000:12345-192.168.201.4@tcp:35:lfs.0 00010000:00010000:1.0:1788510606.956939:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66891 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.956945:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510606.956950:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66891 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.956968:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66891 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.956985:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff929a8831a800) 00010000:00010000:1.0:1788510606.956988:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788510606.957007:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66891 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.957013:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66891 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510606.957188:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a4c306d-b06e-474a-992e-0460ff45898c+9:14432:x1875388852720000:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 251us (503us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788510606.957196:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 2 00000100:00100000:1.0:1788510606.964067:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510606.964486:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852720256 00000100:00100000:2.0:1788510606.964499:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852720256 00000100:00100000:2.0:1788510606.964571:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 25 00000100:00100000:2.0:1788510606.964583:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a4c306d-b06e-474a-992e-0460ff45898c+9:14432:x1875388852720256:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510606.964612:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510606.964714:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66898 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736d2 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.964866:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed6689f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.964884:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed6689f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.964897:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed6689f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.964912:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.964918:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.964923:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510606.965046:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788510606.965368:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed6689f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965377:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed6689f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965407:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed6689f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965414:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510606.965418:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed6689f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965425:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed6689f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965440:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8831a400) 00010000:00010000:2.0:1788510606.965443:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510606.965448:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed6689f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965455:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed6689f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965468:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965475:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965481:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965486:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510606.965489:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965505:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965513:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff929a8831a900) 00010000:00010000:2.0:1788510606.965515:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510606.965518:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965525:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965567:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66898 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736d2 expref: 11 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965578:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8831a400) 00010000:00010000:2.0:1788510606.965580:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788510606.965584:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66898 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736d2 expref: 11 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510606.965593:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77e00, rc 0) 00000100:00100000:2.0:1788510606.965729:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a4c306d-b06e-474a-992e-0460ff45898c+10:14432:x1875388852720256:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 1147us (1674us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788510606.965737:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 25 00000100:00100000:0.0:1788510606.968786:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510606.968899:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852720384 00000100:00100000:1.0:1788510606.968907:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852720384 00000100:00100000:1.0:1788510606.968958:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 26 00000100:00100000:1.0:1788510606.968969:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a4c306d-b06e-474a-992e-0460ff45898c+10:14432:x1875388852720384:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510606.968994:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510606.969016:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed668b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736d9 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.969100:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.969112:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.969122:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510606.969142:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788510606.969171:0:14453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510606.969196:0:14453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.969300:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033c00/0x3e734462ed668b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736d9 expref: 12 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.969415:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736d9 expref: 11 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510606.969422:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff929a85fa0d00) 00010000:00010000:1.0:1788510606.969424:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788510606.969427:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032c00, rc 0) 00000100:00100000:1.0:1788510606.969473:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a4c306d-b06e-474a-992e-0460ff45898c+11:14432:x1875388852720384:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 508us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510606.969478:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 26 00000100:00100000:3.0:1788510606.982623:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510606.982710:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852720512 00000100:00100000:1.0:1788510606.982723:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852720512 00000100:00100000:1.0:1788510606.982791:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 3 00000100:00100000:1.0:1788510606.982801:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a4c306d-b06e-474a-992e-0460ff45898c+11:14432:x1875388852720512:12345-192.168.201.4@tcp:37:lfs.0 00000100:00100000:1.0:1788510606.987042:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a4c306d-b06e-474a-992e-0460ff45898c+11:14432:x1875388852720512:12345-192.168.201.4@tcp:37:lfs.0 Request processed in 4229us (4418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510606.987057:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 3 00000100:00100000:0.0:1788510606.992331:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510606.992379:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852720768 00000100:00100000:2.0:1788510606.992391:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852720768 00000100:00100000:2.0:1788510606.992453:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:2.0:1788510606.992464:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8561f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a4c306d-b06e-474a-992e-0460ff45898c+11:14432:x1875388852720768:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:2.0:1788510606.992811:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8561f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a4c306d-b06e-474a-992e-0460ff45898c+12:14432:x1875388852720768:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 349us (499us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788510606.992820:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 4 00000100:00100000:3.0:1788510607.063454:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510607.063642:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852720896 00000100:00100000:0.0:1788510607.063652:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852720896 00000100:00100000:0.0:1788510607.063711:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 27 00000100:00100000:0.0:1788510607.063722:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+10:14438:x1875388852720896:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:0.0:1788510607.063745:0:16328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510607.063777:0:16328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed668c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736e0 expref: -99 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.063883:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed668c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.063898:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed668c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.063912:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed668c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.063928:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed668d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.063934:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed668d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.063939:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed668d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064035:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed668d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064043:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed668d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064049:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed668d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788510607.064073:0:16328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788510607.064076:0:16328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788510607.064111:0:16328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed668d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064130:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed668c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064137:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed668c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064143:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed668c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064159:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510607.064164:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed668c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064171:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed668c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064184:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8831a400) 00010000:00010000:0.0:1788510607.064187:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510607.064191:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed668c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064198:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed668c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064211:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed668d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064216:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed668d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064289:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed668d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064300:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eafa00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510607.064304:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed668d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064309:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed668d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064317:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff929a8b8f5300) 00010000:00010000:0.0:1788510607.064319:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510607.064322:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed668d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064327:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eafa00/0x3e734462ed668d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064357:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed668c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736e0 expref: 12 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064371:0:16328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eae800/0x3e734462ed668d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736e0 expref: 11 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.064378:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff929a85fa0d00) 00010000:00010000:0.0:1788510607.064381:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788510607.064383:0:16328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eae800, rc 0) 00000100:00100000:0.0:1788510607.064444:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+11:14438:x1875388852720896:12345-192.168.201.4@tcp:101:bash.0 Request processed in 724us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510607.064451:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 27 00000100:00100000:0.0:1788510607.067574:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510607.067736:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852721152 00000100:00100000:2.0:1788510607.067747:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852721152 00000100:00100000:2.0:1788510607.067827:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 28 00000100:00100000:2.0:1788510607.067838:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+11:14438:x1875388852721152:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510607.067858:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510607.067881:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed668de lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736e7 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.068003:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.068019:0:14451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736d9 expref: 11 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.068030:0:14451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.068075:0:14451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736d9 expref: 11 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.068089:0:14451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736d9 expref: 11 pid: 14453 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510607.068104:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1875388861100160:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510607.069121:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab4b2a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788510607.071647:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510607.071724:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852721280 00000100:00100000:0.0:1788510607.071733:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852721280 00010000:00010000:0.0:1788510607.071777:0:14437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736d9 expref: 12 pid: 14453 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510607.071836:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:0.0:1788510607.071847:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a4c306d-b06e-474a-992e-0460ff45898c+12:2341:x1875388852721280:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510607.071863:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510607.071869:0:14437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736d9 expref: 12 pid: 14453 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.071882:0:14437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736d9 expref: 12 pid: 14453 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.071904:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff929a85fa0d00) 00010000:00010000:0.0:1788510607.071910:0:14437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.071919:0:14437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.071927:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510607.071948:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510607.072010:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a4c306d-b06e-474a-992e-0460ff45898c+12:2341:x1875388852721280:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 165us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510607.072018:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 10 00010000:00010000:2.0:1788510607.073705:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032c00/0x3e734462ed668bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736d9 expref: 11 pid: 14453 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510607.073733:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1875388861100160:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510607.073760:0:14451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.073770:0:14451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.073776:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.073821:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed668ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.073833:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed668ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.073845:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed668ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.075813:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed668f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.075831:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed668f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.075842:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed668f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510607.075869:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788510607.075898:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.075905:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.075912:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.075917:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510607.075921:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.075929:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.075941:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff929a85fa0d00) 00010000:00010000:2.0:1788510607.075945:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510607.075950:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.075956:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed668e5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788510607.075968:0:14451:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d04e06d reply state 00000000c4d64bab transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed668ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510607.075977:0:14451:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788510607.076014:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed668de lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736e7 expref: 14 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.076040:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed668f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736e7 expref: 13 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.076048:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:2.0:1788510607.076050:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788510607.076053:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77c00, rc 0) 00000100:00100000:2.0:1788510607.076144:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+14:14438:x1875388852721152:12345-192.168.201.4@tcp:101:bash.0 Request processed in 8307us (8579us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788510607.076161:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 28 00010000:00010000:3.0:1788510607.083075:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed668ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510607.083095:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed668ec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510607.083104:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed668ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510607.083125:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510607.083130:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed668ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510607.083138:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed668ec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510607.083168:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff929a8831a900) 00010000:00010000:3.0:1788510607.083171:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510607.083177:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed668ec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510607.083185:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed668ec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510607.090900:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510607.091050:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852721408 00000100:00100000:2.0:1788510607.091062:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852721408 00000100:00100000:2.0:1788510607.091127:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 29 00000100:00100000:2.0:1788510607.091138:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+13:14438:x1875388852721408:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510607.091180:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510607.091203:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66901 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736ee expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.091320:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66908 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.091335:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66908 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.091346:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66908 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510607.091385:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788510607.091402:0:14452:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510607.091423:0:14452:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66908 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.091434:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66908 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.091457:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66901 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736ee expref: 15 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.091474:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66908 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736ee expref: 14 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.091483:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:2.0:1788510607.091485:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510607.091489:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76600, rc 0) 00000100:00100000:2.0:1788510607.091546:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+14:14438:x1875388852721408:12345-192.168.201.4@tcp:101:bash.0 Request processed in 410us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510607.091553:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 29 00000100:00100000:1.0:1788510607.095283:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510607.095455:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852721664 00000100:00100000:2.0:1788510607.095466:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852721664 00000100:00100000:2.0:1788510607.095527:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 5 00000100:00100000:2.0:1788510607.095538:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+14:14438:x1875388852721664:12345-192.168.201.4@tcp:35:bash.0 00000100:00100000:2.0:1788510607.096195:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+15:14438:x1875388852721664:12345-192.168.201.4@tcp:35:bash.0 Request processed in 656us (971us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788510607.096206:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 5 00010000:00010000:2.0:1788510607.108573:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510607.222325:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510607.222483:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852721920 00000100:00100000:1.0:1788510607.222493:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852721920 00000100:00100000:1.0:1788510607.222564:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 30 00000100:00100000:1.0:1788510607.222589:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+15:14448:x1875388852721920:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510607.222633:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510607.222662:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed6690f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736f5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510607.222793:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788510607.222964:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed6690f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736f5 expref: 17 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.222981:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8831a400) 00010000:00010000:1.0:1788510607.222985:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788510607.222990:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed6690f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736f5 expref: 17 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.223009:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033800, rc 0) 00000100:00100000:1.0:1788510607.223092:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+16:14448:x1875388852721920:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 505us (779us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788510607.223099:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 30 00000100:00100000:0.0:1788510607.228009:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510607.228113:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852722176 00000100:00100000:2.0:1788510607.228122:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852722176 00000100:00100000:2.0:1788510607.228199:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:2.0:1788510607.228210:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+16:14448:x1875388852722176:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:2.0:1788510607.228481:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+17:14448:x1875388852722176:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 271us (480us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788510607.228489:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 6 00000100:00100000:0.0:1788510607.270683:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510607.270800:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852722432 00000100:00100000:2.0:1788510607.270812:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852722432 00000100:00100000:2.0:1788510607.270880:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 31 00000100:00100000:2.0:1788510607.270890:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+17:14451:x1875388852722432:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510607.270915:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510607.270937:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed6691d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc736fc expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.271046:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66924 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.271059:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66924 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.271072:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66924 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510607.271083:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788510607.271260:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed6691d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736fc expref: 20 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.271280:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66924 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736fc expref: 19 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.271309:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:2.0:1788510607.271312:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510607.271316:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77200, rc 0) 00000100:00100000:2.0:1788510607.271388:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+19:14451:x1875388852722432:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 499us (717us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788510607.271395:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 31 00000100:00100000:3.0:1788510607.275445:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510607.275635:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852722688 00000100:00100000:1.0:1788510607.275653:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852722688 00000100:00100000:1.0:1788510607.275750:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:1.0:1788510607.275771:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+19:2343:x1875388852722688:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510607.275800:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510607.275835:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66924 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736fc expref: 19 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.275862:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:1.0:1788510607.275886:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510607.275957:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+18:2343:x1875388852722688:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 196us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510607.275965:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:3.0:1788510607.279773:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510607.279864:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852722560 00000100:00100000:1.0:1788510607.279874:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852722560 00000100:00100000:1.0:1788510607.279933:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 32 00000100:00100000:1.0:1788510607.279944:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+18:14451:x1875388852722560:12345-192.168.201.4@tcp:54:lfs.0 00010000:00010000:1.0:1788510607.280012:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66932 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.280028:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66932 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.280039:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66932 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.280063:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66932 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.280069:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66932 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.280075:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66932 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.280081:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83033800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510607.280085:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66932 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.280092:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66932 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.280115:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:1.0:1788510607.280118:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788510607.280123:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66932 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.280129:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66932 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510607.280262:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+18:14451:x1875388852722560:12345-192.168.201.4@tcp:54:lfs.0 Request processed in 274us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510607.280270:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 32 00000100:00100000:2.0:1788510607.283988:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510607.284177:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852722944 00000100:00100000:3.0:1788510607.284191:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852722944 00000100:00100000:3.0:1788510607.284600:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 7 00000100:00100000:3.0:1788510607.284613:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+18:14451:x1875388852722944:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510607.285016:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+19:14451:x1875388852722944:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 405us (1039us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788510607.285024:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 7 00000040:00080000:2.0:1788510607.429007:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788510607.557173:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788510607.557202:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aae94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861100288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788510607.557552:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510607.557739:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861100288 00000100:00100000:0.0:1788510607.557747:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861100288 00000100:00100000:0.0:1788510607.557827:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788510607.557840:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861100288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788510607.557874:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510607.557925:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861100288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510607.557933:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788510607.557979:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aae94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861100288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788510607.558103:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788510607.598052:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510607.598176:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852723200 00000100:00100000:2.0:1788510607.598187:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852723200 00000100:00100000:2.0:1788510607.598298:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00100000:2.0:1788510607.598310:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+19:14482:x1875388852723200:12345-192.168.201.4@tcp:101:cat.0 00010000:00010000:2.0:1788510607.599773:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510607.599803:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66939 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73703 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.599931:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66940 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.599951:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66940 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.599966:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66940 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510607.599979:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788510607.600190:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66939 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73703 expref: 22 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.600258:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66940 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73703 expref: 21 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.600268:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:2.0:1788510607.600271:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510607.600276:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76c00, rc 0) 00000100:00100000:2.0:1788510607.600404:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+21:14482:x1875388852723200:12345-192.168.201.4@tcp:101:cat.0 Request processed in 2096us (2363us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788510607.600412:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 33 00000100:00100000:0.0:1788510607.605050:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510607.605158:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852723456 00000100:00100000:1.0:1788510607.605173:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852723456 00000100:00100000:1.0:1788510607.605280:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:1.0:1788510607.605293:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+21:14482:x1875388852723456:12345-192.168.201.4@tcp:35:cat.0 00000100:00100000:1.0:1788510607.605946:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+22:14482:x1875388852723456:12345-192.168.201.4@tcp:35:cat.0 Request processed in 652us (905us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788510607.605956:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 8 00000100:00100000:0.0:1788510607.615931:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510607.616037:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852723584 00000100:00100000:1.0:1788510607.616050:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852723584 00000100:00100000:1.0:1788510607.616122:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 1 00000100:00100000:1.0:1788510607.616135:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+22:2342:x1875388852723584:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510607.616165:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510607.616192:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66940 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73703 expref: 22 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.616271:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:1.0:1788510607.616278:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510607.616334:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+21:2342:x1875388852723584:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 202us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510607.616341:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 1 00000100:00100000:0.0:1788510607.708978:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510607.709094:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852723840 00000100:00100000:1.0:1788510607.709104:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852723840 00000100:00100000:1.0:1788510607.709542:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 34 00000100:00100000:1.0:1788510607.709559:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+21:14488:x1875388852723840:12345-192.168.201.4@tcp:101:dd.0 00010000:00010000:1.0:1788510607.709589:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510607.709614:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed6694e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7370a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.709713:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66955 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.709729:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66955 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.709741:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66955 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510607.709764:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788510607.710051:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed6694e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7370a expref: 24 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.710071:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66955 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7370a expref: 23 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.710094:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:1.0:1788510607.710097:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788510607.710101:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033000, rc 0) 00000100:00100000:1.0:1788510607.710540:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+23:14488:x1875388852723840:12345-192.168.201.4@tcp:101:dd.0 Request processed in 986us (1571us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788510607.710548:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 34 00000100:00100000:0.0:1788510607.714823:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510607.714952:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852724096 00000100:00100000:2.0:1788510607.714963:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852724096 00000100:00100000:2.0:1788510607.715028:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 35 00000100:00100000:2.0:1788510607.715038:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+23:14488:x1875388852724096:12345-192.168.201.4@tcp:36:dd.0 00010000:00010000:2.0:1788510607.715114:0:16328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788510607.715159:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033000/0x3e734462ed66955 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7370a expref: 23 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.715184:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66908 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736ee expref: 22 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.715195:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:2.0:1788510607.715200:0:16328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788510607.715447:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66963 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.715464:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66963 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510607.715482:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66963 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788510607.715538:0:16328:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788510607.715576:0:16328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b040a28d reply state 000000000f56ff16 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66963 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510607.715586:0:16328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788510607.715689:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+24:14488:x1875388852724096:12345-192.168.201.4@tcp:36:dd.0 Request processed in 651us (873us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788510607.715697:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 35 00000020:00080000:2.0:1788510607.715702:0:16328:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788510607.721603:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66963 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.721623:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66963 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.721631:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66963 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.721638:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510607.721643:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66963 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.721652:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66963 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.721669:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:1.0:1788510607.721672:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510607.721678:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66963 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510607.721685:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66963 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510607.791967:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510607.792118:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852724352 00000100:00100000:3.0:1788510607.792127:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852724352 00000100:00100000:3.0:1788510607.792309:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:3.0:1788510607.792319:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+23:14488:x1875388852724352:12345-192.168.201.4@tcp:35:dd.0 00000100:00100000:3.0:1788510607.792580:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+24:14488:x1875388852724352:12345-192.168.201.4@tcp:35:dd.0 Request processed in 262us (624us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788510607.792588:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 9 00000100:00100000:3.0:1788510608.016215:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510608.016394:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852724480 00000100:00100000:1.0:1788510608.016416:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852724480 00000100:00100000:1.0:1788510608.016503:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 36 00000100:00100000:1.0:1788510608.016515:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+24:14502:x1875388852724480:12345-192.168.201.4@tcp:101:stat.0 00010000:00010000:1.0:1788510608.016539:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510608.016559:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed6696a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73711 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.016625:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66971 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.016639:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66971 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.016652:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66971 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.016666:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66978 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.016673:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66978 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.016680:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66978 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.016788:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6697f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.016796:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6697f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.016818:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6697f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510608.016856:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788510608.016860:0:14453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510608.017167:0:14453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6697f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017182:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6697f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017193:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66971 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017200:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66971 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017206:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66971 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017212:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510608.017216:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66971 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017255:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66971 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017268:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff929a85fa0d00) 00010000:00010000:1.0:1788510608.017271:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510608.017276:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66971 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017293:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66971 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017310:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66978 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017316:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66978 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017322:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66978 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017328:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510608.017331:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66978 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017338:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66978 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017345:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff929a85fa0e00) 00010000:00010000:1.0:1788510608.017348:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510608.017351:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66978 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017357:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66978 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017405:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed6696a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73711 expref: 26 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017421:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6697f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73711 expref: 25 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.017436:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:1.0:1788510608.017438:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788510608.017441:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032600, rc 0) 00000100:00100000:1.0:1788510608.017516:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+25:14502:x1875388852724480:12345-192.168.201.4@tcp:101:stat.0 Request processed in 1003us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510608.017524:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 36 00000100:00080000:2.0:1788510608.018569:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788510608.123933:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510608.124393:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852724736 00000100:00100000:2.0:1788510608.124408:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852724736 00000100:00100000:2.0:1788510608.124485:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 37 00000100:00100000:2.0:1788510608.124499:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+25:14508:x1875388852724736:12345-192.168.201.4@tcp:36:truncate.0 00010000:00010000:2.0:1788510608.124570:0:16328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510608.124605:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed6697f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73711 expref: 25 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.124630:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:2.0:1788510608.124638:0:16328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788510608.125064:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66986 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.125080:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.125112:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788510608.125496:0:16328:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788510608.125525:0:16328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000761826ee reply state 00000000e41f8088 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510608.125535:0:16328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788510608.125682:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+27:14508:x1875388852724736:12345-192.168.201.4@tcp:36:truncate.0 Request processed in 1185us (1759us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788510608.125691:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 37 00000020:00080000:2.0:1788510608.125697:0:16328:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788510608.132512:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510608.138375:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.138393:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66986 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.138400:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66986 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.138406:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510608.138410:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66986 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.138417:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66986 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.138433:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:3.0:1788510608.138436:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510608.138440:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66986 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.138467:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76600/0x3e734462ed66986 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510608.309358:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510608.309455:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852724864 00000100:00100000:2.0:1788510608.309466:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852724864 00000100:00100000:2.0:1788510608.309540:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 38 00000100:00100000:2.0:1788510608.309550:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+26:14522:x1875388852724864:12345-192.168.201.4@tcp:101:stat.0 00010000:00010000:2.0:1788510608.309575:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510608.309601:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed6698d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73718 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309668:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed66994 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309682:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed66994 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309696:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed66994 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309728:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6699b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309736:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6699b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309743:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6699b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309824:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309833:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309841:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510608.309879:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788510608.309883:0:14453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510608.309904:0:14453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309916:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309924:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed66994 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309931:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed66994 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309948:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed66994 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309959:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510608.309964:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed66994 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309982:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed66994 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.309995:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff929a85fa0d00) 00010000:00010000:2.0:1788510608.309998:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510608.310003:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed66994 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.310010:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed66994 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.310026:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6699b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.310032:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6699b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.310038:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6699b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.310043:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510608.310046:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6699b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.310064:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6699b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.310072:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff929a8831a500) 00010000:00010000:2.0:1788510608.310075:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510608.310078:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6699b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.310084:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed6699b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.310116:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed6698d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73718 expref: 28 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.310141:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73718 expref: 27 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.310150:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:2.0:1788510608.310152:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788510608.310155:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76200, rc 0) 00000100:00100000:2.0:1788510608.310260:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+27:14522:x1875388852724864:12345-192.168.201.4@tcp:101:stat.0 Request processed in 673us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510608.310269:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 38 00000100:00100000:0.0:1788510608.401708:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510608.401841:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852725120 00000100:00100000:1.0:1788510608.401850:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852725120 00000100:00100000:1.0:1788510608.401900:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 39 00000100:00100000:1.0:1788510608.401910:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+27:14532:x1875388852725120:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:1.0:1788510608.401929:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510608.401948:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed669a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7371f expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510608.402039:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788510608.402344:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed669a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7371f expref: 29 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.402355:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8831a400) 00010000:00010000:1.0:1788510608.402358:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788510608.402361:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed669a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7371f expref: 29 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.402379:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033800, rc 0) 00000100:00100000:1.0:1788510608.402427:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+28:14532:x1875388852725120:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 520us (729us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1788510608.402445:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 39 00000100:00100000:0.0:1788510608.413633:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510608.414741:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852725376 00000100:00100000:3.0:1788510608.414753:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852725376 00000100:00100000:3.0:1788510608.414823:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:3.0:1788510608.414833:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8561e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+28:14532:x1875388852725376:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510608.415083:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8561e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+29:14532:x1875388852725376:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 250us (1458us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788510608.415091:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 10 00000100:00100000:0.0:1788510608.504353:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510608.504495:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852725632 00000100:00100000:2.0:1788510608.504508:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852725632 00000100:00100000:2.0:1788510608.504583:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 40 00000100:00100000:2.0:1788510608.504604:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+29:14539:x1875388852725632:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510608.504632:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510608.504672:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669b7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73726 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.504811:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.504826:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed668f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736e7 expref: 30 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.504835:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73718 expref: 30 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.504843:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.504884:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73718 expref: 30 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.504899:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73718 expref: 30 pid: 14453 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510608.504914:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14453:1875388861100416:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510608.505031:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed668f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736e7 expref: 30 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.505041:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed668f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736e7 expref: 30 pid: 14451 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510608.505049:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14453:1875388861100544:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510608.505078:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c79cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510608.508725:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14453:1875388861100416:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510608.508741:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14453:1875388861100544:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510608.508840:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510608.509730:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510608.509773:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510608.512859:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852725760 00000100:00100000:1.0:1788510608.512875:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852725760 00010000:00010000:1.0:1788510608.512940:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73718 expref: 31 pid: 14453 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510608.513074:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852725888 00000100:00100000:1.0:1788510608.513079:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852725888 00010000:00010000:1.0:1788510608.513096:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed668f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736e7 expref: 32 pid: 14451 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510608.513112:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:1.0:1788510608.513121:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929ab7ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+32:2341:x1875388852725760:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510608.513146:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510608.513154:0:14438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73718 expref: 32 pid: 14453 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.513170:0:14438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73718 expref: 32 pid: 14453 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.513197:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76200/0x3e734462ed669a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73718 expref: 32 pid: 14453 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.513220:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:1.0:1788510608.513259:0:14438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.513290:0:14438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.513297:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510608.513373:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929ab7ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+31:2341:x1875388852725760:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 252us (3646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510608.513381:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:1.0:1788510608.513433:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:1.0:1788510608.513440:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+30:2341:x1875388852725888:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510608.513448:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510608.513453:0:14438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed668f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736e7 expref: 30 pid: 14451 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.513463:0:14438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed668f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736e7 expref: 30 pid: 14451 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.513475:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed668f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc736e7 expref: 30 pid: 14451 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.513485:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:1.0:1788510608.513489:0:14438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.513499:0:14438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.513507:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.513540:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788510608.513559:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+29:2341:x1875388852725888:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 119us (3785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510608.513566:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 12 00010000:00010000:3.0:1788510608.515813:0:14453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.515829:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788510608.515852:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788510608.516024:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669b7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73726 expref: 30 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.516049:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73726 expref: 29 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.516060:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:3.0:1788510608.516063:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788510608.516068:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77400, rc 0) 00000100:00100000:3.0:1788510608.516154:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+29:14539:x1875388852725632:12345-192.168.201.4@tcp:101:bash.0 Request processed in 11560us (11809us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788510608.516179:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 40 00000100:00100000:0.0:1788510608.522028:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510608.522159:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852726144 00000100:00100000:2.0:1788510608.522169:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852726144 00000100:00100000:2.0:1788510608.522245:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 41 00000100:00100000:2.0:1788510608.522254:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+29:14539:x1875388852726144:12345-192.168.201.4@tcp:36:bash.0 00010000:00010000:2.0:1788510608.522516:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.522534:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.522546:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788510608.522675:0:16328:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788510608.522707:0:16328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae9b2725 reply state 000000002a3ecd1d transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510608.522715:0:16328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788510608.522956:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+32:14539:x1875388852726144:12345-192.168.201.4@tcp:36:bash.0 Request processed in 701us (935us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788510608.523217:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 41 00000020:00080000:2.0:1788510608.523325:0:16328:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788510608.527138:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.527158:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.527166:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.527173:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510608.527179:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.527187:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669cc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.527204:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:3.0:1788510608.527208:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510608.527215:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669cc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.527255:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510608.528582:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510608.529141:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852726272 00000100:00100000:3.0:1788510608.529153:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852726272 00000100:00100000:3.0:1788510608.529309:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 42 00000100:00100000:3.0:1788510608.529330:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+31:14539:x1875388852726272:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:3.0:1788510608.529362:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510608.529402:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed669d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7372d expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.529458:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed669d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7372d expref: 32 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.529473:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed669d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7372d expref: 32 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.529493:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:3.0:1788510608.529496:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788510608.529500:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69e00, rc 0) 00000100:00100000:3.0:1788510608.529572:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+32:14539:x1875388852726272:12345-192.168.201.4@tcp:101:bash.0 Request processed in 252us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510608.529580:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 42 00000100:00100000:1.0:1788510608.545398:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510608.545504:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852726400 00000100:00100000:2.0:1788510608.545545:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852726400 00000100:00100000:2.0:1788510608.545624:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 43 00000100:00100000:2.0:1788510608.545634:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+32:14539:x1875388852726400:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510608.545654:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510608.545678:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669da lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73734 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.545793:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed669e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.545806:0:14452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73726 expref: 33 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.545813:0:14452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed669e1 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.545843:0:14452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73726 expref: 33 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.545853:0:14452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73726 expref: 33 pid: 14453 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510608.545864:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14452:1875388861100672:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510608.545956:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c79cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510608.548058:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14452:1875388861100672:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510608.548102:0:14452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed669e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510608.550111:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510608.550266:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852726528 00000100:00100000:3.0:1788510608.550276:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852726528 00010000:00010000:3.0:1788510608.550399:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73726 expref: 34 pid: 14453 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510608.550488:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:3.0:1788510608.550499:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+34:2341:x1875388852726528:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510608.550523:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510608.550530:0:14438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73726 expref: 34 pid: 14453 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.550543:0:14438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73726 expref: 34 pid: 14453 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.550587:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77400/0x3e734462ed669be lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73726 expref: 34 pid: 14453 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.550608:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:3.0:1788510608.550613:0:14438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed669e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.550626:0:14438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed669e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.550635:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed669e1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510608.550669:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788510608.550728:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+33:2341:x1875388852726528:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 231us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510608.550735:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 13 00010000:00010000:1.0:1788510608.550935:0:14452:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed669e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.550945:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed669e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510608.551003:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788510608.551008:0:14452:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788510608.551036:0:14452:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed669e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.551069:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77600/0x3e734462ed669da lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73734 expref: 33 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.551085:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed669e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73734 expref: 32 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510608.551092:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:1.0:1788510608.551095:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788510608.551098:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77c00, rc 0) 00000100:00100000:1.0:1788510608.551149:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+32:14539:x1875388852726400:12345-192.168.201.4@tcp:101:bash.0 Request processed in 5516us (5761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510608.551167:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 43 00000100:00100000:1.0:1788510608.554980:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510608.555047:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852726784 00000100:00100000:0.0:1788510608.555058:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852726784 00000100:00100000:0.0:1788510608.555141:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 2 00000100:00100000:0.0:1788510608.555154:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+32:14539:x1875388852726784:12345-192.168.201.4@tcp:103:bash.0 00010000:00010000:0.0:1788510608.555193:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788510608.555239:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77c00/0x3e734462ed669e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73734 expref: 32 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510608.555263:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed669d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7372d expref: 31 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510608.555275:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831ac00) 00010000:00010000:0.0:1788510608.555289:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510608.555368:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+30:14539:x1875388852726784:12345-192.168.201.4@tcp:103:bash.0 Request processed in 217us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510608.555375:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 2 00000100:00100000:1.0:1788510608.558677:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510608.558855:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852726912 00000100:00100000:2.0:1788510608.558888:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852726912 00000100:00100000:2.0:1788510608.558976:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 44 00000100:00100000:2.0:1788510608.558991:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aae949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+30:14539:x1875388852726912:12345-192.168.201.4@tcp:58:bash.0 00010000:00010000:2.0:1788510608.559118:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.559159:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510608.559175:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788510608.560359:0:14453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788510608.560528:0:14453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788510608.560624:0:14453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788510608.560786:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aae949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+30:14539:x1875388852726912:12345-192.168.201.4@tcp:58:bash.0 Request processed in 1792us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510608.560798:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 44 00000100:00100000:3.0:1788510608.568701:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510608.568782:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852727040 00000100:00100000:0.0:1788510608.568792:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852727040 00000100:00100000:0.0:1788510608.568854:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 45 00000100:00100000:0.0:1788510608.568865:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+30:14539:x1875388852727040:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:0.0:1788510608.568886:0:16328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788510608.568908:0:16328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed669ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7373b expref: -99 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510608.568964:0:16328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510608.568976:0:16328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed669ef lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7373b expref: 31 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510608.568997:0:16328:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510608.569027:0:16328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed669ef lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7373b expref: 31 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510608.569041:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831a500) 00010000:00010000:0.0:1788510608.569044:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788510608.569048:0:16328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed669ef lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7373b expref: 31 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510608.569056:0:16328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a90eaec00, rc 0) 00000100:00100000:0.0:1788510608.569133:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+31:14539:x1875388852727040:12345-192.168.201.4@tcp:101:bash.0 Request processed in 260us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510608.569140:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 45 00000100:00100000:1.0:1788510608.580560:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861100800:0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.580641:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510608.580691:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861101312:0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.580725:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510608.580754:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788510608.580760:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861100928:0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.580786:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510608.580804:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861101440:0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.580821:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510608.580848:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861101184:0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.580869:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510608.580886:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788510608.580892:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9299836c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861101056:0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.580911:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510608.580940:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861100800 00000100:00100000:1.0:1788510608.580948:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861100800 00000100:00100000:1.0:1788510608.581003:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788510608.581015:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:3288:x1875388861100800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.581080:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4d56e3b-8589-453f-93c5-42174bfbbc5c+19:3288:x1875388861100800:12345-0@lo:400:kworker.0 Request processed in 67us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510608.581088:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788510608.581144:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861100928 00000100:00100000:1.0:1788510608.581165:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861100928 00000100:00100000:1.0:1788510608.581199:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861101056 00000100:00100000:1.0:1788510608.581202:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861101056 00000100:00100000:1.0:1788510608.581263:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788510608.581273:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861100928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.581310:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875388861100928:12345-0@lo:400:kworker.0 Request processed in 40us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510608.581315:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788510608.581326:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788510608.581332:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861101056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.581366:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861101056:12345-0@lo:400:kworker.0 Request processed in 34us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510608.581373:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788510608.581396:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788510608.581432:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861101056:0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.581469:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3288:1875388861100928:0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.581481:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9299836c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4d56e3b-8589-453f-93c5-42174bfbbc5c:3288:1875388861100800:0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.581514:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861101312 00000100:00100000:1.0:1788510608.581517:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861101312 00000100:00080000:1.0:1788510608.581535:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510608.581555:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861101440 00000100:00100000:1.0:1788510608.581558:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861101440 00000100:00080000:1.0:1788510608.581569:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788510608.581578:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861101184 00000100:00100000:1.0:1788510608.581581:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861101184 00000100:00100000:1.0:1788510608.581595:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788510608.581602:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861101312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.581654:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875388861101312:12345-0@lo:400:kworker.0 Request processed in 52us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510608.581660:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788510608.581687:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3288:1875388861101312:0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.581705:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788510608.581712:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861101440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.581747:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875388861101440:12345-0@lo:400:kworker.0 Request processed in 36us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510608.581753:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788510608.581775:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3288:1875388861101440:0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.581791:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788510608.581798:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861101184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788510608.581829:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875388861101184:12345-0@lo:400:kworker.0 Request processed in 31us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510608.581836:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788510608.581858:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875388861101184:0@lo:400:kworker.0 00000100:00100000:0.0:1788510608.582040:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abb1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861101568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788510608.582074:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510608.582587:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861101568 00000100:00100000:0.0:1788510608.582593:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861101568 00000100:00100000:0.0:1788510608.582626:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788510608.582633:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861101568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788510608.582662:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510608.582698:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1875388861101568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510608.582704:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788510608.582793:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abb1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3290:1875388861101568:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788510608.660750:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000001:00080000:1.0:1788510608.660981:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1788510608.660992:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:1.0:1788510608.661002:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:1.0:1788510608.661023:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1788510609.156835:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788510609.476475:0:14483:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788510609.476486:0:14483:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788510609.477281:0:14483:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788510609.477293:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788510609.477426:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaea7b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14483:1875388861101696:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788510609.479245:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c79c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788510609.482518:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaea7b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14483:1875388861101696:192.168.201.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788510609.489578:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510609.489712:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852727168 00000100:00100000:3.0:1788510609.489722:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852727168 00000100:00100000:3.0:1788510609.489918:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:3.0:1788510609.489932:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a429815a-88fd-43fc-b7af-9ff8bdb64520+10:14540:x1875388852727168:12345-192.168.201.4@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788510609.490043:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a429815a-88fd-43fc-b7af-9ff8bdb64520+10:14540:x1875388852727168:12345-192.168.201.4@tcp:900:lhsmtool_posix.0 Request processed in 113us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510609.490051:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:3.0:1788510609.516077:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510609.522947:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852727296 00000100:00100000:1.0:1788510609.522971:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852727296 00000100:00100000:1.0:1788510609.523078:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 46 00000100:00100000:1.0:1788510609.523443:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+10:14540:x1875388852727296:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788510609.523509:0:14451:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788510609.523711:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+10:14540:x1875388852727296:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 622us (7708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510609.523719:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 46 00000100:00100000:1.0:1788510609.528492:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.528983:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852727424 00000100:00100000:2.0:1788510609.528995:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852727424 00000100:00100000:2.0:1788510609.529084:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 47 00000100:00100000:2.0:1788510609.529131:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+10:14540:x1875388852727424:12345-192.168.201.4@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788510609.529220:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed669f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529268:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed669f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529283:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed669f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529337:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed669fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529345:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed669fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529351:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed669fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529378:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66a04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529387:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529393:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510609.529433:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788510609.529437:0:14453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510609.529450:0:14453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529472:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed669f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529479:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed669f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529486:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed669f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529491:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510609.529496:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed669f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529503:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed669f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529515:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a85fa0c00) 00010000:00010000:2.0:1788510609.529518:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510609.529523:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed669f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529530:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed669f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529545:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed669fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529551:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed669fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529557:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed669fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529570:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76c00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510609.529572:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed669fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529579:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed669fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529587:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff929a8831aa00) 00010000:00010000:2.0:1788510609.529589:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510609.529592:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed669fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529599:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed669fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529614:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529621:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66a04 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529627:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66a04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529632:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec77200 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:2.0:1788510609.529635:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66a04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529640:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66a04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529656:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831a500) 00010000:00010000:2.0:1788510609.529659:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788510609.529662:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66a04 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.529667:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77200/0x3e734462ed66a04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510609.529969:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+10:14540:x1875388852727424:12345-192.168.201.4@tcp:34:lhsmtool_posix.0 Request processed in 840us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510609.529978:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 47 00000100:00100000:3.0:1788510609.535051:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510609.536038:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852727680 00000100:00100000:1.0:1788510609.536054:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852727680 00000100:00100000:1.0:1788510609.536183:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 48 00000100:00100000:1.0:1788510609.536196:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+10:14540:x1875388852727680:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788510609.536240:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510609.536286:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66a0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73742 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.536419:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a12 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.536438:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.536452:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788510609.536467:0:14452:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788510609.536670:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.536679:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a12 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.536686:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.536705:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510609.536710:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.536717:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a12 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.537292:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831a500) 00010000:00010000:1.0:1788510609.537298:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788510609.537304:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a12 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.537311:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a12 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.537366:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66a0b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73742 expref: 12 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.537379:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff929a85fa0c00) 00010000:00010000:1.0:1788510609.537381:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788510609.537386:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032a00/0x3e734462ed66a0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73742 expref: 12 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.537396:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032a00, rc 0) 00000100:00100000:1.0:1788510609.538347:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+11:14540:x1875388852727680:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 2145us (3299us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1788510609.538360:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 48 00000100:00100000:3.0:1788510609.544340:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.544635:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852727808 00000100:00100000:2.0:1788510609.544647:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852727808 00000100:00100000:2.0:1788510609.544713:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00100000:2.0:1788510609.544737:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+11:14540:x1875388852727808:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788510609.544793:0:14453:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788510609.544927:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+11:14540:x1875388852727808:12345-192.168.201.4@tcp:53:lhsmtool_posix.0 Request processed in 204us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510609.544937:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 49 00000100:00100000:0.0:1788510609.548413:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510609.549334:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852728064 00000100:00100000:3.0:1788510609.549346:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852728064 00000100:00100000:3.0:1788510609.549426:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 50 00000100:00100000:3.0:1788510609.549437:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+11:14540:x1875388852728064:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510609.549461:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510609.549488:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed66a20 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73749 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788510609.550840:0:14451:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788510609.550850:0:14451:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788510609.550963:0:14451:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788510609.552688:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66a27 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.557354:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66a27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.557374:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66a27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.557642:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed66a20 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73749 expref: 14 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.557665:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66a27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73749 expref: 13 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.557675:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff929a83eaba00) 00010000:00010000:3.0:1788510609.557677:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788510609.557703:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929ab4a69e00, rc 0) 00000100:00100000:3.0:1788510609.558197:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+13:14540:x1875388852728064:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 8758us (9790us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788510609.558209:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 50 00000100:00100000:1.0:1788510609.570434:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510609.570781:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852728320 00000100:00100000:0.0:1788510609.570790:0:16328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852728320 00000100:00100000:0.0:1788510609.570854:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 51 00000100:00100000:0.0:1788510609.570863:0:16328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+13:14540:x1875388852728320:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788510609.570917:0:16328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510609.570941:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69e00/0x3e734462ed66a27 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73749 expref: 13 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.570959:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff929a83eaba00) 00010000:00010000:0.0:1788510609.570967:0:16328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788510609.570988:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66a35 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.570999:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66a35 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571006:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66a35 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571060:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66a3c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x534710f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571068:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66a3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x534710f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571074:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66a3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x534710f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571352:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66a35 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571371:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66a35 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571377:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66a35 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571383:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaee00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510609.571388:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66a35 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571396:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66a35 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571405:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff929a85fa0d00) 00010000:00010000:0.0:1788510609.571408:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510609.571412:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66a35 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571418:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66a35 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571429:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66a3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x534710f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571435:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66a3c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x534710f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571440:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66a3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x534710f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571445:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510609.571453:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66a3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x534710f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571459:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66a3c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x534710f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.571467:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x534710f (ffff929a8b8f5600) 00010000:00010000:0.0:1788510609.571470:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510609.572550:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66a3c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x534710f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.572560:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66a3c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x534710f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510609.572777:0:16328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+12:14540:x1875388852728320:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 1834us (2274us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788510609.572788:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 51 00000100:00100000:0.0:1788510609.575199:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510609.577987:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852728448 00000100:00100000:1.0:1788510609.578003:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852728448 00000100:00100000:1.0:1788510609.578082:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 52 00000100:00100000:1.0:1788510609.578094:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+12:14540:x1875388852728448:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788510609.578125:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510609.578150:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a43 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73750 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.578190:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66a4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.578207:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.578245:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.578365:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73750 expref: 14 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.578388:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83033800/0x3e734462ed66a4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73750 expref: 13 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.578399:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff929a85fa0e00) 00010000:00010000:1.0:1788510609.578402:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788510609.578407:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83033800, rc 0) 00000100:00100000:1.0:1788510609.578498:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+13:14540:x1875388852728448:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 406us (3307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510609.578506:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 52 00000100:00100000:2.0:1788510609.581142:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510609.581549:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852728704 00000100:00100000:0.0:1788510609.581562:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852728704 00000100:00100000:0.0:1788510609.581634:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 53 00000100:00100000:0.0:1788510609.581653:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+13:14540:x1875388852728704:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788510609.581770:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66a51 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.581789:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.581802:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788510609.582487:0:14453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788510609.582502:0:14453:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 467401277494ns, next at 468401274971ns, rc = 0 00000004:00010000:0.0:1788510609.582639:0:14453:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8ade34d reply state 00000000f1b18ced transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510609.582652:0:14453:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788510609.582789:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+15:14540:x1875388852728704:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 1136us (1655us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788510609.582799:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 53 00010000:00010000:3.0:1788510609.587064:0:3274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.587083:0:3274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66a51 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.587089:0:3274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66a51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.587094:0:3274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510609.587098:0:3274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66a51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.587103:0:3274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66a51 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.587132:0:3274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff929a85fa0e00) 00010000:00010000:3.0:1788510609.587135:0:3274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788510609.587140:0:3274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66a51 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.587148:0:3274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66a51 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510609.589928:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510609.590263:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852728832 00000100:00100000:1.0:1788510609.590275:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852728832 00000100:00100000:1.0:1788510609.590332:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 54 00000100:00100000:1.0:1788510609.590342:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaea7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+14:14540:x1875388852728832:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788510609.590368:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510609.590391:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73757 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.590483:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73757 expref: 15 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.590502:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73757 expref: 15 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.590526:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff929a85fa0e00) 00010000:00010000:1.0:1788510609.590529:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788510609.590533:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032400, rc 0) 00000100:00100000:1.0:1788510609.590614:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaea7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+15:14540:x1875388852728832:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 272us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510609.590622:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 54 00000100:00100000:0.0:1788510609.593539:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.593967:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852728960 00000100:00100000:2.0:1788510609.593981:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852728960 00000100:00100000:2.0:1788510609.594079:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:2.0:1788510609.594096:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+5:2340:x1875388852728960:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788510609.595811:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2340:x1875388852728960:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 Request processed in 1488us (2051us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788510609.595839:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00080000:1.0:1788510609.595925:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788510609.601342:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510609.601509:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852729216 00000100:00100000:3.0:1788510609.601523:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852729216 00000100:00100000:3.0:1788510609.601621:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:3.0:1788510609.602030:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+15:14540:x1875388852729216:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788510609.602361:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+16:14540:x1875388852729216:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 724us (1030us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788510609.602368:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 11 00000100:00100000:0.0:1788510609.613575:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.613980:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852729472 00000100:00100000:2.0:1788510609.613992:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852729472 00000100:00100000:2.0:1788510609.614058:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 55 00000100:00100000:2.0:1788510609.614070:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+16:14540:x1875388852729472:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788510609.614500:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+16:14540:x1875388852729472:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 431us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510609.614509:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 55 00000100:00100000:0.0:1788510609.629007:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510609.629045:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852729600 00000100:00100000:3.0:1788510609.629058:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852729600 00000100:00100000:3.0:1788510609.629145:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 56 00000100:00100000:3.0:1788510609.629159:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+16:14540:x1875388852729600:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788510609.629185:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788510609.629257:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed66a5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7375e expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.629944:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66a66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.629964:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66a66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.629978:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66a66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510609.630024:0:14451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788510609.630047:0:14451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66a66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.630088:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929ab4a69200/0x3e734462ed66a5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7375e expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.630120:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66a66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7375e expref: 17 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.630128:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff929a85fa0e00) 00010000:00010000:2.0:1788510609.630152:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788510609.630158:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76c00, rc 0) 00000100:00100000:2.0:1788510609.630271:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+17:14540:x1875388852729600:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 1114us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510609.630280:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 56 00000100:00100000:3.0:1788510609.634495:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510609.634609:0:16680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852729728 00000100:00100000:1.0:1788510609.634620:0:16680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852729728 00000100:00100000:1.0:1788510609.634696:0:16680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:1.0:1788510609.634709:0:16680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2341:x1875388852729728:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788510609.634751:0:16680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788510609.634779:0:16680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000101d9b2c/0x3e734462ed66a6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73765 expref: -99 pid: 16680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788510609.634829:0:16680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a8191, blocks: 0x1 00010000:00010000:1.0:1788510609.634856:0:16680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788510609.634861:0:16680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510609.634873:0:16680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000101d9b2c/0x3e734462ed66a6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73765 expref: 7 pid: 16680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.634900:0:16680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000101d9b2c/0x3e734462ed66a6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73765 expref: 7 pid: 16680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.634916:0:16680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929a83032600, rc 0) 00000100:00100000:1.0:1788510609.634983:0:16680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:2341:x1875388852729728:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 276us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510609.634990:0:16680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:0.0:1788510609.641973:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.642148:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852729984 00000100:00100000:2.0:1788510609.642162:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852729984 00000100:00100000:2.0:1788510609.642288:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 57 00000100:00100000:2.0:1788510609.642302:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+17:14540:x1875388852729984:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788510609.642427:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+17:14540:x1875388852729984:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 127us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510609.642436:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 57 00000100:00100000:0.0:1788510609.648948:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510609.649049:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852730112 00000100:00100000:1.0:1788510609.649059:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852730112 00000100:00100000:1.0:1788510609.649131:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 58 00000100:00100000:1.0:1788510609.649143:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+17:14540:x1875388852730112:12345-192.168.201.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788510609.720201:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:1.0:1788510609.720214:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788510609.720358:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861101824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788510609.720438:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510609.720520:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861101824 00000100:00100000:1.0:1788510609.720528:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861101824 00000100:00100000:1.0:1788510609.720581:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788510609.720589:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875388861101824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788510609.721415:0:15135:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788510609.721421:0:15135:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788510609.721423:0:15135:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788510609.721425:0:15135:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788510609 -> 1788510609 00002000:00010000:1.0:1788510609.721429:0:15135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788510609.721497:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1875388861101824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 907us (1058us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788510609.721507:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788510609.721545:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788510609.721606:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff929aaf0edc00/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788510609.721612:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3291:1875388861101824:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1788510609.721677:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:0.0:1788510609.722302:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+13:14540:x1875388852730112:12345-192.168.201.4@tcp:44:lhsmtool_posix.0 Request processed in 73155us (73359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510609.722313:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 58 00000100:00100000:3.0:1788510609.725376:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.725567:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852730240 00000100:00100000:2.0:1788510609.725579:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852730240 00000100:00100000:2.0:1788510609.725663:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:2.0:1788510609.725676:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:2340:x1875388852730240:12345-192.168.201.4@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788510609.726373:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:2340:x1875388852730240:12345-192.168.201.4@tcp:16:lhsmtool_posix.0 Request processed in 689us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510609.726384:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:1.0:1788510609.738322:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.738563:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852730496 00000100:00100000:2.0:1788510609.738578:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852730496 00000100:00100000:2.0:1788510609.738665:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 59 00000100:00100000:2.0:1788510609.738677:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+13:14540:x1875388852730496:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788510609.738765:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788510609.738815:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76c00/0x3e734462ed66a66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7375e expref: 13 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.738863:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff929a85fa0e00) 00010000:00010000:2.0:1788510609.738869:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788510609.738909:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a74 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.738927:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.738938:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788510609.739298:0:14453:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8c54e39 reply state 00000000fa06558b transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510609.739314:0:14453:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788510609.739456:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+14:14540:x1875388852730496:12345-192.168.201.4@tcp:36:lhsmtool_posix.0 Request processed in 780us (1149us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788510609.739464:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 59 00010000:00010000:3.0:1788510609.742010:0:3275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.742028:0:3275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a74 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.742036:0:3275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.742042:0:3275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:3.0:1788510609.742047:0:3275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.742056:0:3275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a74 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.742096:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff929a85fa0e00) 00010000:00010000:3.0:1788510609.742098:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788510609.742116:0:3275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a74 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.742123:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a74 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510609.743424:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.743690:0:16681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852730624 00000100:00100000:2.0:1788510609.743703:0:16681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852730624 00000100:00100000:2.0:1788510609.743778:0:16681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:2.0:1788510609.743790:0:16681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:14540:x1875388852730624:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788510609.743814:0:16681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510609.743834:0:16681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7376c expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.743870:0:16681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000101d9b2c/0x3e734462ed66a6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73765 expref: 8 pid: 16680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.743902:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510609.743908:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510609.743914:0:16681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 8 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.743958:0:16681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000101d9b2c/0x3e734462ed66a6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73765 expref: 8 pid: 16680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.743973:0:16681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000101d9b2c/0x3e734462ed66a6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73765 expref: 8 pid: 16680 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510609.743989:0:16681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16681:1875388861101952:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510609.744098:0:16681:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510609.748318:0:16681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16681:1875388861101952:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510609.748431:0:16681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 8 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.748459:0:16681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76c00, rc 0) 00000100:00100000:2.0:1788510609.748532:0:16681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a429815a-88fd-43fc-b7af-9ff8bdb64520+8:14540:x1875388852730624:12345-192.168.201.4@tcp:101:lhsmtool_posix.0 Request processed in 4743us (5115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510609.748542:0:16681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 17 00000100:00100000:3.0:1788510609.749712:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510609.749963:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852730752 00000100:00100000:1.0:1788510609.749972:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852730752 00010000:00010000:1.0:1788510609.750010:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000101d9b2c/0x3e734462ed66a6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73765 expref: 8 pid: 16680 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510609.750060:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:1.0:1788510609.750070:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+8:2341:x1875388852730752:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788510609.750085:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788510609.750123:0:14438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000101d9b2c/0x3e734462ed66a6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73765 expref: 8 pid: 16680 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.750138:0:14438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000101d9b2c/0x3e734462ed66a6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73765 expref: 8 pid: 16680 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.750179:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000101d9b2c/0x3e734462ed66a6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73765 expref: 8 pid: 16680 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.750196:0:14438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510609.750201:0:14438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788510609.750209:0:14438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 7 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.750376:0:14438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 7 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.750420:0:14438:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 7 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510609.750436:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14438:1875388861102080:192.168.201.4@tcp:105: 00000100:00100000:1.0:1788510609.750520:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a857c3480 going to sleep for 11 seconds 00000100:00100000:1.0:1788510609.754150:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.754261:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852730880 00000100:00100000:2.0:1788510609.754271:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852730880 00000100:00100000:2.0:1788510609.754341:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:2.0:1788510609.754350:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+8:2343:x1875388852730880:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788510609.754902:0:15134:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788510609.754908:0:15134:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788510608 00002000:00010000:2.0:1788510609.754911:0:15134:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788510607 00002000:00010000:2.0:1788510609.754913:0:15134:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788510609 -> 1788510608 00002000:00010000:2.0:1788510609.754915:0:15134:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788510609.755023:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:2343:x1875388852730880:12345-192.168.201.4@tcp:2:lhsmtool_posix.0 Request processed in 672us (881us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788510609.755031:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:3.0:1788510609.755142:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14438:1875388861102080:192.168.201.4@tcp:105: 00010000:00010000:3.0:1788510609.755166:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510609.755792:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+8:2341:x1875388852730752:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 5719us (6082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510609.755804:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:1.0:1788510609.762055:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.765818:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852731008 00000100:00100000:2.0:1788510609.765837:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852731008 00000100:00100000:2.0:1788510609.765984:0:15136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:2.0:1788510609.765998:0:15136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+8:2341:x1875388852731008:12345-192.168.201.4@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788510609.766053:0:15136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.766078:0:15136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 8 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.766088:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510609.766093:0:15136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788510609.766098:0:15136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.766149:0:15136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 8 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.766184:0:15136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 8 pid: 16681 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510609.766202:0:15136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15136:1875388861102208:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510609.766337:0:15136:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c796c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788510609.769965:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510609.770039:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852731136 00000100:00100000:0.0:1788510609.770049:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852731136 00010000:00010000:0.0:1788510609.770090:0:14436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 9 pid: 16681 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510609.770171:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:0.0:1788510609.770183:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:2340:x1875388852731136:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788510609.770198:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788510609.770254:0:14436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 9 pid: 16681 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.770270:0:14436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 9 pid: 16681 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.770293:0:14436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788510609.770298:0:14436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788510609.770305:0:14436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.770314:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.770336:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788510609.770403:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+9:2340:x1875388852731136:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 221us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510609.770411:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 15 00010000:00010000:2.0:1788510609.772676:0:15136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66a7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7376c expref: 8 pid: 16681 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510609.772705:0:15136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15136:1875388861102208:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510609.772738:0:15136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.772751:0:15136:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.772759:0:15136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.772809:0:15136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.772818:0:15136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.772857:0:15136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.772865:0:15136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:2.0:1788510609.772870:0:15136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.772881:0:15136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.772900:0:15136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.772908:0:15136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006615e31f/0x3e734462ed66a82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510609.772996:0:15136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:2341:x1875388852731008:12345-192.168.201.4@tcp:1:lhsmtool_posix.0 Request processed in 7000us (10949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510609.773004:0:15136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:3.0:1788510609.777829:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.778117:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852731392 00000100:00100000:2.0:1788510609.778130:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852731392 00000100:00100000:2.0:1788510609.778200:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 60 00000100:00100000:2.0:1788510609.778213:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+13:14540:x1875388852731392:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788510609.778522:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66a89 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.779002:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66a89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.779018:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66a89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.779317:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.779332:0:14451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a58 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73757 expref: 14 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.779342:0:14451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.780510:0:14451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73757 expref: 14 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.780539:0:14451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a58 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73757 expref: 14 pid: 14452 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788510609.780559:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1875388861102336:192.168.201.4@tcp:104: 00000100:00100000:2.0:1788510609.780933:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a88c796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788510609.784925:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1875388861102336:192.168.201.4@tcp:104: 00010000:00010000:2.0:1788510609.784963:0:14451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510609.786262:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510609.786522:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852731520 00000100:00100000:0.0:1788510609.786532:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852731520 00010000:00010000:0.0:1788510609.786578:0:14438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a58 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73757 expref: 15 pid: 14452 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510609.787622:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 16 00000100:00100000:3.0:1788510609.788076:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+15:2340:x1875388852731520:12345-192.168.201.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788510609.788117:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788510609.788132:0:14436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a58 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73757 expref: 15 pid: 14452 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.788154:0:14436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73757 expref: 15 pid: 14452 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.788184:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032400/0x3e734462ed66a58 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73757 expref: 15 pid: 14452 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.788208:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff929a85fa0e00) 00010000:00010000:3.0:1788510609.788286:0:14436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.788298:0:14436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.788306:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.788345:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788510609.789027:0:14451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.789052:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788510609.789850:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+14:2340:x1875388852731520:12345-192.168.201.4@tcp:103:ldlm_bl.0 Request processed in 2205us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510609.789865:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 16 00000001:00080000:2.0:1788510609.790708:0:14451:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788510609.791048:0:14451:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788510609.791094:0:14451:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788510609.791263:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14451:1875388861102464:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788510609.792966:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788510609.793017:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff929ab7c70900 going to sleep for 11 seconds 00000100:00100000:0.0:1788510609.793132:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861102464 00000100:00100000:0.0:1788510609.793143:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861102464 00000100:00100000:0.0:1788510609.793199:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788510609.793209:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14451:x1875388861102464:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788510609.793435:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14451:x1875388861102464:12345-0@lo:1000:mdt00_000.0 Request processed in 227us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510609.793443:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788510609.800548:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaee5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14451:1875388861102464:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788510609.804800:0:14451:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788510609.804908:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14451:1875388861102592:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788510609.804978:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788510609.805016:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a857c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788510609.808408:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861102592 00000100:00100000:0.0:1788510609.808430:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861102592 00000100:00100000:0.0:1788510609.808518:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788510609.808534:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14451:x1875388861102592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788510609.808902:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14451:x1875388861102592:12345-0@lo:1000:mdt00_000.0 Request processed in 371us (3922us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788510609.808912:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788510609.810648:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14451:1875388861102592:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788510609.810750:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810763:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810771:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810779:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76a00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510609.810784:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810794:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810816:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff929a85fa0e00) 00010000:00010000:1.0:1788510609.810820:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788510609.810827:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810834:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76a00/0x3e734462ed66a90 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810878:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810884:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810889:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810903:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76800 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510609.810907:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810912:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810921:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831a500) 00010000:00010000:1.0:1788510609.810924:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788510609.810934:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed669ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7373b expref: 17 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810948:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed669ef lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7373b expref: 17 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.810959:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed669ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7373b expref: 17 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.811051:0:14451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaec00/0x3e734462ed669ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7373b expref: 17 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510609.811070:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929aaf0eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1875388861102720:192.168.201.4@tcp:105: 00000100:00100000:1.0:1788510609.811194:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff929a857c3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788510609.815090:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929aaf0eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14451:1875388861102720:192.168.201.4@tcp:105: 00010000:00010000:1.0:1788510609.815135:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815164:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76800/0x3e734462ed669e8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815198:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed66a97 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815212:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed66a97 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815243:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed66a97 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815253:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed66a97 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815260:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed66a97 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815266:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed66a97 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815272:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a83032600 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510609.815276:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed66a97 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815283:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed66a97 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815293:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831a500) 00010000:00010000:1.0:1788510609.815296:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788510609.815300:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed66a97 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815310:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a83032600/0x3e734462ed66a97 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815320:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66a89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815326:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66a89 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815330:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66a89 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815335:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76e00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:1.0:1788510609.815337:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66a89 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815342:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66a89 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815350:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831a500) 00010000:00010000:1.0:1788510609.815352:0:14451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788510609.815355:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66a89 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788510609.815361:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76e00/0x3e734462ed66a89 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788510609.815620:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+17:14540:x1875388852731392:12345-192.168.201.4@tcp:57:lhsmtool_posix.0 Request processed in 37407us (37801us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788510609.815630:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 60 00000040:00080000:2.0:1788510609.815904:0:14483:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788510609.815909:0:14483:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788510609.815960:0:14483:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788510609.815966:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000020:00080000:1.0:1788510609.816272:0:14451:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788510609.817064:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510609.817491:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852731648 00000100:00100000:1.0:1788510609.817501:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852731648 00000100:00100000:1.0:1788510609.817566:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 12 00000100:00100000:1.0:1788510609.817578:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+17:14539:x1875388852731648:12345-192.168.201.4@tcp:49:bash.0 00000100:00100000:3.0:1788510609.823908:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.824082:0:14455:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788510609.824092:0:14455:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1788510609.824485:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852731904 00000100:00100000:3.0:1788510609.824495:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852731904 00000100:00100000:2.0:1788510609.824652:0:16683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 13 00000100:00100000:2.0:1788510609.824664:0:16683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+18:14540:x1875388852731904:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788510609.826018:0:16683:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788510609.826159:0:16683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:0.0:1788510609.829026:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+20:14539:x1875388852731648:12345-192.168.201.4@tcp:49:bash.0 Request processed in 11434us (11948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510609.829049:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 12 00010000:00010000:2.0:1788510609.834161:0:16683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66a9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.834188:0:16683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66a9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.834201:0:16683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66a9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.834211:0:16683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66a9e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.834244:0:16683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66a9e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.834260:0:16683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66a9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.834294:0:16683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788510609.834424:0:16683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+19:14540:x1875388852731904:12345-192.168.201.4@tcp:35:lhsmtool_posix.0 Request processed in 9758us (10525us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788510609.834436:0:16683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 13 00000020:00080000:2.0:1788510609.834443:0:16683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788510609.835304:0:14439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788510609.835320:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66a9e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.835331:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929aaec76000 already unused, calling callback (ffffffffc15884f0) 00010000:00010000:3.0:1788510609.835336:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66a9e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.835348:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66a9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.835379:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff929a85fa0e00) 00010000:00010000:3.0:1788510609.835383:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788510609.835388:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66a9e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.835415:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec76000/0x3e734462ed66a9e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788510609.835435:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510609.835436:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788510609.835438:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510609.837169:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.837262:0:16681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852732032 00000100:00100000:2.0:1788510609.837273:0:16681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852732032 00000100:00100000:2.0:1788510609.837338:0:16681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:2.0:1788510609.837350:0:16681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a429815a-88fd-43fc-b7af-9ff8bdb64520+7:14539:x1875388852732032:12345-192.168.201.4@tcp:101:bash.0 00010000:00010000:2.0:1788510609.837536:0:16681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510609.837571:0:16681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66aa5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc73773 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788510609.837610:0:16681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9a8190, atime: 0x6a9a818f, ctime: 0x6a9a8190, blocks: 0x1 00010000:00010000:2.0:1788510609.837715:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1788510609.837845:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788510609.837861:0:16681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66aa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73773 expref: 8 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.837884:0:16681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002109e893/0x3e734462ed66aa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc73773 expref: 8 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.837926:0:16681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec76c00, rc 0) 00000100:00100000:2.0:1788510609.838005:0:16681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a429815a-88fd-43fc-b7af-9ff8bdb64520+8:14539:x1875388852732032:12345-192.168.201.4@tcp:101:bash.0 Request processed in 657us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510609.838013:0:16681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:0.0:1788510609.847349:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510609.847497:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852732288 00000100:00100000:3.0:1788510609.847509:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852732288 00000100:00100000:3.0:1788510609.847580:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 14 00000100:00100000:3.0:1788510609.847593:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+19:14539:x1875388852732288:12345-192.168.201.4@tcp:35:bash.0 00000001:00080000:3.0:1788510609.847947:0:14455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1788510609.848058:0:14455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1788510609.848525:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+22:14539:x1875388852732288:12345-192.168.201.4@tcp:35:bash.0 Request processed in 932us (1184us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1788510609.848535:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 14 00000020:00080000:3.0:1788510609.848541:0:14455:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788510609.961616:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:2.0:1788510609.961718:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852732544 00000100:00100000:2.0:1788510609.961730:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852732544 00000100:00100000:2.0:1788510609.961801:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 61 00000100:00100000:2.0:1788510609.961812:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abaf22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+22:14550:x1875388852732544:12345-192.168.201.4@tcp:101:lfs.0 00010000:00010000:2.0:1788510609.961842:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788510609.961867:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66aac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf61805ecc7377a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788510609.961963:0:14453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788510609.962112:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66aac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7377a expref: 24 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.962129:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff929a8831a400) 00010000:00010000:2.0:1788510609.962132:0:14453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788510609.962138:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929aaec77e00/0x3e734462ed66aac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.4@tcp remote: 0xfcf61805ecc7377a expref: 24 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788510609.962153:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff929aaec77e00, rc 0) 00000100:00100000:2.0:1788510609.962627:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abaf22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+23:14550:x1875388852732544:12345-192.168.201.4@tcp:101:lfs.0 Request processed in 814us (1019us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788510609.962635:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 61 00000100:00100000:1.0:1788510609.965910:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:0.0:1788510609.965997:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852732672 00000100:00100000:0.0:1788510609.966008:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852732672 00000100:00100000:0.0:1788510609.966069:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 62 00000100:00100000:0.0:1788510609.966079:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+23:14550:x1875388852732672:12345-192.168.201.4@tcp:34:lfs.0 00010000:00010000:0.0:1788510609.966192:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66aba lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966272:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66aba lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966288:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66aba lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966309:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66ac1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966317:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966324:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966568:0:14452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66ac8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966578:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966585:0:14452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788510609.966627:0:14452:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966640:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66aba lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966647:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66aba lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966664:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66aba lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966670:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaee00 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510609.966674:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66aba lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966681:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66aba lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966692:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff929a85fa0d00) 00010000:00010000:0.0:1788510609.966695:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510609.966700:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66aba lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966706:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaee00/0x3e734462ed66aba lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966719:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966725:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966730:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966734:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf000 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510609.966736:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966751:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966759:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff929a8b8f5300) 00010000:00010000:0.0:1788510609.966761:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510609.966764:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66ac1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966770:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf000/0x3e734462ed66ac1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966785:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966791:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966795:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966800:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff929a90eaf400 already unused, calling callback (ffffffffc1f974f0) 00010000:00010000:0.0:1788510609.966802:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966808:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966814:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff929a8831a500) 00010000:00010000:0.0:1788510609.966816:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788510609.966819:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66ac8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788510609.966833:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff929a90eaf400/0x3e734462ed66ac8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14452 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788510609.966924:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+23:14550:x1875388852732672:12345-192.168.201.4@tcp:34:lfs.0 Request processed in 845us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510609.966932:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 62 00000100:00100000:1.0:1788510609.971027:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510609.971477:0:16683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852732928 00000100:00100000:3.0:1788510609.971494:0:16683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852732928 00000100:00100000:3.0:1788510609.971633:0:16683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 15 00000100:00100000:3.0:1788510609.971647:0:16683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+23:14550:x1875388852732928:12345-192.168.201.4@tcp:35:lfs.0 00000100:00100000:3.0:1788510609.972076:0:16683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+24:14550:x1875388852732928:12345-192.168.201.4@tcp:35:lfs.0 Request processed in 430us (1063us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1788510609.972085:0:16683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 15 00010000:00010000:2.0:1788510610.182287:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788510611.205108:0:16132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510611.561624:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510611.561665:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510611.561698:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510611.561729:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510611.561750:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510611.561769:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510611.561793:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510611.561824:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852733312 00000100:00100000:3.0:1788510611.561834:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852733312 00000100:00100000:3.0:1788510611.561889:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852733824 00000100:00100000:3.0:1788510611.561893:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852733824 00000100:00100000:3.0:1788510611.561907:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852733440 00000100:00100000:3.0:1788510611.561910:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852733440 00000100:00100000:3.0:1788510611.561922:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852733696 00000100:00100000:3.0:1788510611.561924:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852733696 00000100:00100000:3.0:1788510611.561939:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:3.0:1788510611.561947:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+8:2341:x1875388852733312:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510611.562015:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+8:2341:x1875388852733312:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 67us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510611.562023:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 18 00000100:00100000:3.0:1788510611.562039:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:3.0:1788510611.562045:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a4c306d-b06e-474a-992e-0460ff45898c+5:2341:x1875388852733824:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510611.562070:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a4c306d-b06e-474a-992e-0460ff45898c+5:2341:x1875388852733824:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510611.562087:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 19 00000100:00100000:3.0:1788510611.562100:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:3.0:1788510611.562105:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+5:2341:x1875388852733440:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510611.562129:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+5:2341:x1875388852733440:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510611.562134:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 20 00000100:00100000:3.0:1788510611.562154:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:3.0:1788510611.562160:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a8894b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a4c306d-b06e-474a-992e-0460ff45898c+5:2341:x1875388852733696:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510611.562183:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a8894b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a4c306d-b06e-474a-992e-0460ff45898c+5:2341:x1875388852733696:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510611.562189:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:3.0:1788510611.562207:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852733568 00000100:00100000:3.0:1788510611.562210:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852733568 00000100:00100000:3.0:1788510611.562258:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852733184 00000100:00100000:3.0:1788510611.562262:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852733184 00000100:00100000:3.0:1788510611.562282:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 30 00000100:00100000:3.0:1788510611.562288:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaed50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a4c306d-b06e-474a-992e-0460ff45898c+6:2341:x1875388852733568:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510611.562319:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaed50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a4c306d-b06e-474a-992e-0460ff45898c+6:2341:x1875388852733568:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 31us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510611.562326:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 30 00000100:00100000:3.0:1788510611.562337:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 31 00000100:00100000:3.0:1788510611.562342:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+24:2341:x1875388852733184:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:3.0:1788510611.562368:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a429815a-88fd-43fc-b7af-9ff8bdb64520+24:2341:x1875388852733184:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 27us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788510611.562374:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 31 00000100:00080000:3.0:1788510611.562391:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788510611.562396:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788510611.562398:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788510611.562714:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852733056 00000100:00100000:1.0:1788510611.562719:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852733056 00000100:00100000:1.0:1788510611.562758:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 123 00000100:00100000:1.0:1788510611.562766:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929abb172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:2341:x1875388852733056:12345-192.168.201.4@tcp:400:kworker.0 00000100:00100000:1.0:1788510611.562795:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929abb172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48d35e0e-b5e6-4a99-9da7-b60aaa57b4f0+13:2341:x1875388852733056:12345-192.168.201.4@tcp:400:kworker.0 Request processed in 31us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788510611.562803:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 123 00000001:02000400:2.0:1788510611.639205:0:16721:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1788510612.228485:0:14439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788510612.676461:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788510612.676488:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861102848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788510612.676576:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788510612.676758:0:15138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388861102848 00000100:00100000:0.0:1788510612.676769:0:15138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388861102848 00000100:00100000:0.0:1788510612.676849:0:15138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788510612.676859:0:15138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929a88949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875388861102848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788510612.676896:0:15138:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788510612.685854:0:15138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929a88949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875388861102848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8987us (9267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788510612.685870:0:15138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788510612.685922:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788510612.687780:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff929abaf22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3289:1875388861102848:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788510612.730133:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1788510612.730162:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000100:00100000:1.0:1788510613.112737:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:1.0:1788510613.112794:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.4@tcp (source: 12345-192.168.201.4@tcp) 00000100:00100000:3.0:1788510613.112842:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852734080 00000100:00100000:3.0:1788510613.112854:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852734080 00000100:00100000:3.0:1788510613.112921:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:3.0:1788510613.112933:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff929aaf0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2341:x1875388852734080:12345-192.168.201.4@tcp:16:kworker.0 00000100:00100000:2.0:1788510613.113150:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff929aaf0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2341:x1875388852734080:12345-192.168.201.4@tcp:16:kworker.0 Request processed in 217us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788510613.113159:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 21 00000100:00100000:2.0:1788510613.113200:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875388852733952 00000100:00100000:2.0:1788510613.113204:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875388852733952 00002000:00100000:2.0:1788510613.113280:0:15140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9299836c5880 x1875388852733952/t0(0) o4->a429815a-88fd-43fc-b7af-9ff8bdb64520@192.168.201.4@tcp:184/0 lens 504/0 e 0 to 0 dl 1788510624 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788510613.113291:0:15140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9299836c5880 with x1875388852733952 ext(0->8) 00002000:00010000:2.0:1788510613.113297:0:15140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9299836c5880 00000100:00100000:2.0:1788510613.113315:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.4@tcp, seq: 0 00000100:00100000:2.0:1788510613.113322:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9299836c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+6:2340:x1875388852733952:12345-192.168.201.4@tcp:4:bash.0 00000100:00080000:1.0:1788510613.113437:0:14447:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788510613.114243:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9299836c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a429815a-88fd-43fc-b7af-9ff8bdb64520+8:2340:x1875388852733952:12345-192.168.201.4@tcp:4:bash.0 Request processed in 901us (1428us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788510613.114253:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.4@tcp, seq: 0 00002000:00100000:2.0:1788510613.114262:0:15140:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9299836c5880 x1875388852733952/t8589934598(0) o4->a429815a-88fd-43fc-b7af-9ff8bdb64520@192.168.201.4@tcp:184/0 lens 504/448 e 0 to 0 dl 1788510624 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788510613.114271:0:15140:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9299836c5880 with x1875388852733952 ext(0->8) 00002000:00010000:2.0:1788510613.114275:0:15140:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9299836c5880 00010000:00010000:2.0:1788510613.254274:0:14440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30151 lines, 30151 kept, 0 dropped, 0 bad.